-- Logs begin at Thu 2022-06-30 16:55:09 UTC, end at Thu 2022-06-30 18:46:07 UTC. -- Jun 30 17:44:10.679171 dv-cinder-812685-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 17:44:10.687657 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 17:44:10.689834 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 17:44:10 2022] *** Jun 30 17:44:10.689834 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 17:44:10.689834 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 17:44:10.689834 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: nodename: dv-cinder-812685-15-iscsi Jun 30 17:44:10.689834 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: machine: x86_64 Jun 30 17:44:10.689834 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: clock source: unix Jun 30 17:44:10.689834 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: pcre jit disabled Jun 30 17:44:10.689834 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: detected number of CPU cores: 4 Jun 30 17:44:10.689834 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: current working directory: / Jun 30 17:44:10.690547 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: detected binary path: /usr/bin/uwsgi-core Jun 30 17:44:10.690547 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: your processes number limit is 47680 Jun 30 17:44:10.690547 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: your memory page size is 4096 bytes Jun 30 17:44:10.690547 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: detected max file descriptor number: 2048 Jun 30 17:44:10.690547 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: lock engine: pthread robust mutexes Jun 30 17:44:10.690547 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: thunder lock: enabled Jun 30 17:44:10.690547 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 17:44:10.690547 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 17:44:10.733702 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: Python main interpreter initialized at 0x559f070639c0 Jun 30 17:44:10.733702 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: python threads support enabled Jun 30 17:44:10.733702 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: your server socket listen backlog is limited to 100 connections Jun 30 17:44:10.733702 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: your mercy for graceful operations on workers is 90 seconds Jun 30 17:44:10.734103 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 17:44:10.734232 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: *** Operational MODE: preforking *** Jun 30 17:44:10.734421 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: *** uWSGI is running in multiple interpreter mode *** Jun 30 17:44:10.734421 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: spawned uWSGI master process (pid: 114863) Jun 30 17:44:10.734635 dv-cinder-812685-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 17:44:10.735220 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: spawned uWSGI worker 1 (pid: 114864, cores: 1) Jun 30 17:44:10.735542 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: spawned uWSGI worker 2 (pid: 114865, cores: 1) Jun 30 17:44:10.735700 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 17:44:11.389649 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 17:44:11.390258 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 17:44:12.511851 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 17:44:12.511851 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: from cryptography.utils import int_from_bytes Jun 30 17:44:12.513146 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 17:44:12.513146 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: from cryptography.utils import int_from_bytes Jun 30 17:44:12.513545 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 17:44:12.513545 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: from cryptography.utils import int_from_bytes Jun 30 17:44:12.513683 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 17:44:12.513683 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: from cryptography.utils import int_from_bytes Jun 30 17:44:15.008114 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 17:44:15.008643 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 17:44:15.008999 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 17:44:15.009096 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 17:44:15.009179 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 17:44:15.009259 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 17:44:15.009347 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 17:44:15.009441 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 17:44:15.009527 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 17:44:15.009619 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 17:44:15.009859 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.009951 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.010188 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.010285 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.010538 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.010630 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.010862 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.010952 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.011186 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.011284 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.011496 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.011586 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.011815 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.011915 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.012154 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.012256 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.012481 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.012569 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.012742 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.012839 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.013052 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.013142 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.013374 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-15-iscsi {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.013505 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-15-iscsi {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.013695 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.013799 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.014000 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.014135 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.014304 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.014465 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.014644 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.014733 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.014946 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.015033 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.015260 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.015354 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.015564 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.015658 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.016089 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.016207 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.016484 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.016609 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.016787 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.016915 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.017096 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.017210 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.017426 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.017560 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.017737 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.017836 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.018061 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.018190 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.018395 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.018527 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.018706 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.018821 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.019026 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.019121 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.019333 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.019432 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.019726 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-15-iscsi {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.019814 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-15-iscsi {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.020036 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.020124 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.020349 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.020435 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.020656 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.020751 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.021059 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.021162 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.021368 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.021466 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.021675 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.021762 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.021990 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.022126 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.022312 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.022471 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.022641 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.022725 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.022965 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.023095 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.023280 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.023450 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.023596 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.023685 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.023911 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.023998 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.024210 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.024306 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.024517 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.024605 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.024824 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.024927 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.025138 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.025226 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.025439 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.025526 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.025742 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.025830 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.025992 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.026087 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.026295 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.026424 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.026639 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.026728 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.026958 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.027054 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.027272 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.027361 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.027521 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.028120 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.028296 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.028391 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.028613 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.028709 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.028931 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.029027 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.029239 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.029326 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.029541 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.029627 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.029846 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.029934 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.030149 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.030237 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.030476 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.030566 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.030786 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.030874 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.031090 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.031177 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.031396 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.031489 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.031708 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.031803 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.032020 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.032108 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.032341 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.032440 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.032647 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.032735 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.032965 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.033051 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.033360 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.033459 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.033609 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.033702 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.033913 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.033999 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.034249 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.034364 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.034594 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.034682 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.034899 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.034985 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.035216 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.035316 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.035532 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.035619 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.035837 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.035926 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.036143 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.036231 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.036445 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.036531 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.036760 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.036847 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.037089 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.037187 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.037391 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.037478 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.037639 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.037725 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.037934 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.038029 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.038238 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.038401 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.038575 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.038665 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.038879 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.038976 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.039183 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.039272 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.039487 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.039587 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.039783 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.039907 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.040087 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.040175 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.040392 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.040493 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.040692 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.040778 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.040994 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.041090 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.041297 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.041393 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.041600 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.041685 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.041900 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.041988 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.042203 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.042298 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.042532 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.042629 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.042846 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.042934 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.043164 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.043846 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.044016 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.044104 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.044336 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.044472 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.044628 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.044745 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.044932 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.045060 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.045252 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.045365 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.045556 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.045666 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.045862 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.045958 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.046182 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.046307 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.046515 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.046649 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.046817 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.046910 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.047132 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.047219 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.047434 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.047529 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.047739 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.047835 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.048054 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.048147 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.048352 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.048440 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.048657 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.048752 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.048971 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.049058 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.049275 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.049362 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.049576 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.049663 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.049876 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.049963 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.050179 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.050267 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.050510 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.050600 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.050812 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.050899 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.051115 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.051204 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.051412 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.051499 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.051709 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.051807 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.052023 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.052119 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.052345 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.052435 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.052652 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.052752 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.052958 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.053046 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.053262 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.053383 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.053578 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.053674 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:44:15.053911 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.053998 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.054238 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.054368 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.054609 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.054713 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.054922 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.055011 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.055253 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.055341 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.055580 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.055711 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.055897 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.055983 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.056204 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.056299 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.056517 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.056606 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.056840 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.056927 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.057150 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.057236 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.057462 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.057550 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.057772 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.057858 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.058091 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.058186 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.058437 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.058557 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.058765 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.058854 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.059115 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.059203 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.059433 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.059521 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.059749 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.059835 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.060059 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.060155 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.060376 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.060464 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.060702 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.060788 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.061023 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.061120 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.061332 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.061421 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.061669 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.061758 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.062009 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.062110 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.062322 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.062438 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.062666 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.062754 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.063243 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.063348 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.063551 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.063683 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.063859 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.063947 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.064167 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.064256 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.064486 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.064574 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.064813 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.064902 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.065125 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.065213 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.065440 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.065527 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.065752 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.065869 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.066068 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.066187 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.066401 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.066528 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.066718 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.066842 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.067032 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.067152 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.067371 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.067472 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.067690 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.067778 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.068009 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.068099 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.068324 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.068465 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.068645 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.068783 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.068960 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.069096 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.069273 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.069408 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.069588 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.069720 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.069897 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.070024 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.070204 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.070368 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.070542 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.070650 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.070857 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.070946 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.071164 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.071252 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.071485 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.071583 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.071814 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.071903 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.072124 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.072213 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.072459 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.072548 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.072765 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.072859 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.073076 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.073170 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.073385 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.073473 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.073694 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.073780 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.073997 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.074092 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.074310 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.074467 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.074667 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.074755 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.074975 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.075075 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.075301 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.075389 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.075611 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.075705 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.075917 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.076015 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.076240 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.076329 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.076546 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.076633 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.076850 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.076948 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.077164 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.077252 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.077473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.077562 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.077787 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.077882 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.078096 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.078184 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.078426 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.078519 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.078752 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.078850 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.079067 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.079158 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.079379 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.079466 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.079711 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.079800 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.080041 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.080128 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.080344 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.080432 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.080667 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.080763 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.080993 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.081082 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.081308 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.081394 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.081612 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.081700 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.081918 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.082004 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.082225 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.082312 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.082551 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.082640 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.082857 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.082943 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.083163 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.083260 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.083465 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.083588 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.083766 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.083856 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.084069 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.084169 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.084371 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.084459 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.084674 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.084760 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.084992 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.085088 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.085301 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.085389 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.085605 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.085693 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.085910 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.086050 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.086211 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.086299 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.086576 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.086666 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.086879 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.086967 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.087219 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.087308 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.087554 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.087641 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.087869 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.087957 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.088190 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.088277 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.088502 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.088589 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.088819 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.088907 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.089125 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.089211 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.089437 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.089533 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.089747 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.089835 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.090579 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.090675 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.090922 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.091022 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.091232 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.091321 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.091552 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.091646 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.091860 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.091959 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.092183 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.092278 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.092492 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.092579 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.092813 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.092908 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.093115 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.093204 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.093430 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.093517 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.093765 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.093860 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.094098 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.094193 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.094439 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.094530 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.094765 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.094865 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.095076 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.095172 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.095392 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.095479 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.095701 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.095790 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.096011 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.096144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.096323 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.096417 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.096632 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.096720 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.096950 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.097040 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.097262 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.097349 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.097580 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.097669 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.097887 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.097983 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.098206 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.098303 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.098545 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.098634 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.098861 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.098958 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.099166 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.099254 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.099479 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.099574 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.099806 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.099893 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.100134 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.100232 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.100447 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.100542 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.100757 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.100859 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.101078 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.101180 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.101389 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.101491 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.101701 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.101795 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.102010 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.102106 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.102316 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.102461 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.102641 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.102740 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.102952 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.103049 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.103268 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.103356 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.103576 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.103710 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.103877 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.103968 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.104178 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.104267 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.104491 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.104580 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.104798 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.104887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.105100 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.105188 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.105403 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.105492 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.105749 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.106354 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.106603 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.106692 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.106913 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.107000 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.107234 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.107329 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.107555 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.107651 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.107858 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.107954 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.108161 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.108249 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.108483 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.108571 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.108792 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.108889 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.109095 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.109184 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.109398 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.109486 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.109703 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.109804 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.110043 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.110131 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.110375 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.110467 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.110682 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.110784 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.110998 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.111085 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.111315 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.111402 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.111627 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.111722 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.111939 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.112026 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.112250 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.112344 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.112557 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.112644 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.112877 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.112966 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.113191 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.113278 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.113512 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.113609 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.113800 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.113887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.114111 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.114198 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.114442 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.114534 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.114755 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.114843 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.115078 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.115178 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.115384 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.115480 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.115694 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.115781 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.116004 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.116100 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.116305 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.116394 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.116616 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.116707 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.116931 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.117028 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.117496 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.117584 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.117827 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.117923 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.118140 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.118236 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.118481 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.118572 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.118799 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.118886 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.119118 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.119207 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.119445 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.119539 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.119772 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.119869 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.120113 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.120216 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.120416 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.120520 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.120725 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.120813 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.121029 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.121117 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.121353 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.121450 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.121667 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.121763 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.121974 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.122069 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.122274 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.122388 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.122607 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.122695 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.122915 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.123002 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.123220 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.123310 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.123523 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.123618 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.123826 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.123965 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.124127 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.124258 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.124440 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.124528 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.124744 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.124832 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.125056 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.125153 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.125360 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.125449 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.125683 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.125785 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.125992 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.126082 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.126297 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.126448 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.126625 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.126723 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.126930 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.127026 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.127273 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.127361 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.127575 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.127671 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.127911 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.128009 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.128242 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.128329 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.128579 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.128746 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.128886 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.128982 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.129189 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.129276 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.129512 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.129604 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.129817 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.129912 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.130123 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.130211 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.130448 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.130551 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.130759 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.130856 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.131069 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.131156 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.131369 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.131457 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.131680 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.131768 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.131991 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.132090 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.132298 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.132388 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.132608 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.132696 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.132911 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.133008 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.133217 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.133304 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.133521 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.133608 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.133837 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.133932 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.134143 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.134232 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.134468 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.134557 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.134770 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.134867 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.135078 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.135168 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.135387 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.135475 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.135689 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.135787 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.135997 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.136092 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.136301 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.136395 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.136612 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.136736 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.137425 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.137525 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.137741 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.137829 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.138044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.138134 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.138370 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.138462 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.138684 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.138783 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.139017 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.139111 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.139342 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.139432 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.139655 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.139743 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.139961 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.140049 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.140262 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.140357 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.140575 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.140671 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.140876 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.140964 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.141179 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.141267 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.141487 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.141585 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.141808 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.141904 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.142123 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.142211 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.142446 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.142548 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.142758 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.142846 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.143064 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.143152 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.143365 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.143461 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.143670 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.143756 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.143974 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.144061 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.144276 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.144363 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.144574 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.144667 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.144877 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.144964 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.145176 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.145266 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.145478 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.145565 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.145796 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.145883 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.146104 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.146192 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.146427 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.146530 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.146734 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.146859 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.147038 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.147125 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.147376 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.147471 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.147678 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.147775 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.148035 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.148123 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.148339 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.148435 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.148651 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.148748 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.148963 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.149050 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.149318 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.149416 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.149681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.149790 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.149933 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.150030 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.150182 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.150349 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.150521 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.150622 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.150830 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.151019 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.151140 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.151230 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.151445 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.151613 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.151744 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.151833 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.152063 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.152155 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.152373 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.152473 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.153221 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.153313 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.153552 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.153650 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.153873 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.153962 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.154198 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.154453 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.154594 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.154684 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.154825 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.154914 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.155137 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.155231 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.155442 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.155529 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.155751 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.155841 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.156062 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.156148 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.156371 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.156467 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.156684 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.156779 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.156992 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.157078 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.157303 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.157401 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.157613 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.157700 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.157916 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.158003 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.158226 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.158421 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.158561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.158658 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.158868 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.158954 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.159190 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.159286 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.159501 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.159589 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.159804 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.159901 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.160113 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.160211 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.160418 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.160507 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.160728 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.160815 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.161031 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.161120 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.161460 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.161554 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.161770 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.161858 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.162080 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.162169 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.162406 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.162498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.162721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.162811 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.163031 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.163118 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.163346 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.163421 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.163657 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.163747 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.163963 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.164050 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.164374 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.164461 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.164686 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.164822 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.164998 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.165091 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.165308 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.165395 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.165612 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.165707 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.165917 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.166006 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.166228 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.166314 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.166578 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.166680 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.166889 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.166978 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.167201 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.167289 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.167510 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.167607 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.167835 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.167932 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.168144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.168843 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.168990 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.169081 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.169405 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.169502 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.169720 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.169807 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.170024 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.170112 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.170461 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.170555 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.170776 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.170881 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.171084 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.171172 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.171406 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.171503 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.171727 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.171825 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.172049 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.172136 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.172351 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.172460 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.172663 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.172753 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.172970 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.173072 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.173292 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.173380 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.173612 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.173700 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.173925 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.174027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.174237 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.174343 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.174567 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.174657 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.174890 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.174991 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.175211 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.175299 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.175523 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.175620 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.175845 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.175947 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.176255 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.176345 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.176576 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.176673 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.176887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.176975 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.177203 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.177299 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.177527 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.177622 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.177827 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.177915 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.178130 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.178217 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.178460 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.178552 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.178766 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.178864 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.179069 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.179159 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.179389 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.179490 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.179689 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.179778 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.179998 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.180095 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.180308 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.180409 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.180617 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.180705 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.180925 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.181044 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.181227 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.181336 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.181543 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.181639 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.181847 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.181945 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.182161 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.182261 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.182497 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.182587 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.182819 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.182909 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.183139 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.183237 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.183443 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.183532 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.183763 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.184384 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.184602 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.184693 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.184907 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.185051 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.185208 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.185305 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.185513 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.185601 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.185849 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.185938 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.186154 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.186241 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.186497 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.186588 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.186825 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.186913 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.187149 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.187294 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.187460 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.187556 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.187789 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.187877 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.188371 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.188467 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.188687 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.188774 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.189005 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.189093 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.189329 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.189428 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.189638 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.189725 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.189942 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.190029 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.190256 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.190443 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.190594 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.190684 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.190899 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.190998 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.191203 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.191294 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.191513 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.191608 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.191813 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.191901 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.192114 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.192203 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.192415 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.192511 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.192735 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.192822 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.193036 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.193132 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.193356 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.193445 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.193664 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.193760 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.193969 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.194066 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.194275 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.194412 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.194603 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.194739 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.194944 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.195070 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.195247 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.195339 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.195579 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.195678 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.195899 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.195988 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.196218 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.196308 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.196549 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.196645 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.196857 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.196952 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.197180 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.197275 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.197500 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.197599 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.197814 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.197909 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.198132 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.198220 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.198473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.198579 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.198796 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.198909 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.199109 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.199198 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.199440 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.199607 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.199755 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.199845 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.200072 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.200166 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.200385 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.200481 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.200706 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.200865 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.201244 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.201341 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.201578 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.201666 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.201869 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.201960 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.202180 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.202283 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.202516 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.202606 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.202835 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.202946 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.203143 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.203245 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.203453 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.203551 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.203763 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.203851 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.204068 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.204165 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.204392 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.204528 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.204701 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.204819 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.205026 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.205150 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.205355 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.205473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.205701 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.205819 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.206023 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.206243 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.206409 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.206524 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.206665 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.206781 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.206974 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.207092 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.207321 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.207449 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.207638 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.207763 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.207943 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.208060 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.208258 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.208381 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.208571 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.208709 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.208886 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.209000 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.209196 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.209296 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.209506 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.209597 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.209819 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.209907 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.210128 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.210223 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.210463 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.210558 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.210775 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.210864 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.211085 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.211172 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.211397 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.211495 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.211717 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.211805 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.212048 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.212147 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.212367 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.212454 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.212675 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.212764 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.212986 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.213082 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.213296 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.213392 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.213815 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.213927 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.214132 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.214355 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.214487 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.214615 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.214815 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.215103 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.215209 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.215433 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.215523 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.215755 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.215844 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.216074 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.216172 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.216391 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.216480 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.216701 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.216935 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.217075 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.217251 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.217388 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.217564 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.217695 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.217875 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.218020 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.218182 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.218390 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.218532 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.218662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.218846 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.218985 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.219154 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.219297 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.219474 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.219784 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.219872 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.220169 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.220322 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.220488 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.220678 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.220817 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.221003 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.221145 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.221331 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.221466 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.221660 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.221793 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.221980 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.222083 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.222291 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.222402 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.222647 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.222736 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.222958 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.223049 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.223267 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.223356 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.223585 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.223674 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.223890 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.223979 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.224194 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.224282 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.224499 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.224587 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.224803 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.224900 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.225110 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.225198 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.225415 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.225511 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.225726 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.225824 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.226032 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.226122 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.226370 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.226474 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.226667 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.226764 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.226971 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.227060 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.227276 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.227375 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.227582 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.227676 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.227884 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.227972 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.228189 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.228287 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.228491 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.228579 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.228796 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.228884 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.229105 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.229254 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.229408 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.229524 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.229713 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.229801 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.230016 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.230113 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.230325 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.230431 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.230650 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.231270 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.231532 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.231840 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.231973 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.232150 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.232468 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.232780 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.233104 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.233193 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.233419 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.233733 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.234043 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.234140 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.234439 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.234726 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.234975 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.235155 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.235306 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.235471 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.235620 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.235775 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.235919 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.236074 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.236259 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.236429 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.236568 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.236711 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.236859 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.237052 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.237164 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.237490 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.237639 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.237805 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.238119 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.238453 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.238614 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.238771 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.238964 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.239084 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.239294 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.239383 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.239636 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.239716 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.239976 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.240065 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.240391 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.240510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.240664 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.240983 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.241135 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.241284 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.241435 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.241586 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.241756 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.241908 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.242053 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.242223 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.242434 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.242605 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.242758 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.242910 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.243074 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.243246 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.243394 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.243547 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.243698 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.243854 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.244000 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.244123 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.244210 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.244384 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.244695 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.244784 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.245016 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.245255 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.245343 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.245648 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.245842 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.245938 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.246940 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.247040 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.247268 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.247585 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.247674 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.247947 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.248135 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.248300 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.248633 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.248721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.249074 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.249163 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.249420 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.249659 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.249807 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.250118 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.250252 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.250444 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.250729 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.250868 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.251078 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.251416 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.251511 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.251747 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.252009 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.252107 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.252366 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.252620 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.252715 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.253031 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.253195 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.253356 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.253671 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.253758 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.254103 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.254265 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.254450 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.254776 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.254874 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.255094 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.255182 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.255408 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.255505 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.255723 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.255811 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.256041 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.256130 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.256374 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.256480 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.256663 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.256753 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.256972 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.257060 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.257288 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.257378 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.257599 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.257688 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.257909 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.257998 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.258220 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.258309 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.258554 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.258644 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.258866 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.258955 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.259178 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.259274 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.259491 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.259579 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.259802 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.259881 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.260112 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.260200 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.260416 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.260505 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.260719 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.260815 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.261022 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.261111 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.261329 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.261417 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.261637 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.261735 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.261981 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.262073 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.262291 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.262405 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.262627 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.262929 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.263017 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.263162 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.263253 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.263474 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.263573 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.263782 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.263872 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.264088 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.264175 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.264394 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.264492 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.264701 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.264792 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.265012 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.265100 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.265318 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.265416 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.265625 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.265722 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.265929 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.266025 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.266234 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.266356 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.266564 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.266653 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.266897 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.266997 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.267229 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.267319 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.267575 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.267662 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.267908 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.267997 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.268236 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.268326 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.268561 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.268657 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.268879 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.269053 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.269232 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.269407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.269497 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.269735 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.269865 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.270055 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.270161 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.270390 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.270500 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.270727 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.270853 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.271042 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.271142 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.271404 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.271502 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.271673 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.272264 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.272779 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.272879 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.272958 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.273039 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.273039 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.273039 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.273269 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.273352 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.273428 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.273575 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.273698 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.273897 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.274011 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.274244 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.274358 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.274599 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.275484 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.275484 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.275671 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.275753 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.275753 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 17:44:15.275888 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.276118 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.276446 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.276789 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.277112 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.278258 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.278627 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.278959 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.279284 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.279614 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.279940 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.281083 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.281424 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.281747 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.282081 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.282451 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.282810 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.283138 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.283485 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.283821 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.284142 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.284462 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.284776 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:44:15.285024 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 17:44:15.428658 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO dbcounter [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Registered counter for database nova_api Jun 30 17:44:15.448938 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO dbcounter [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Registered counter for database nova_api Jun 30 17:44:15.449663 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG oslo_db.sqlalchemy.engines [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:44:15.456205 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writer thread running {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:44:15.468811 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_db.sqlalchemy.engines [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:44:15.475360 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writer thread running {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:44:15.512265 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.context [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),971563eb-4a0b-4a3d-98cf-496d4678315e(cell1) {{(pid=114865) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 17:44:15.516135 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG oslo_concurrency.lockutils [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:44:15.517714 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG oslo_concurrency.lockutils [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:44:15.518527 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG oslo_concurrency.lockutils [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:44:15.520460 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG oslo_concurrency.lockutils [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:44:15.522436 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO dbcounter [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Registered counter for database nova_cell0 Jun 30 17:44:15.528267 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO dbcounter [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Registered counter for database nova_cell1 Jun 30 17:44:15.531626 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.context [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),971563eb-4a0b-4a3d-98cf-496d4678315e(cell1) {{(pid=114864) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 17:44:15.535552 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG oslo_db.sqlalchemy.engines [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:44:15.535836 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:44:15.537002 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG oslo_db.sqlalchemy.engines [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:44:15.537305 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:44:15.538116 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:44:15.540091 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:44:15.542092 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO dbcounter [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Registered counter for database nova_cell0 Jun 30 17:44:15.542880 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writer thread running {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:44:15.546671 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writer thread running {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:44:15.551926 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO dbcounter [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Registered counter for database nova_cell1 Jun 30 17:44:15.559520 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_db.sqlalchemy.engines [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:44:15.561196 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_db.sqlalchemy.engines [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:44:15.569578 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writer thread running {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:44:15.570156 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writer thread running {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:44:15.714372 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO dbcounter [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Registered counter for database nova_cell0 Jun 30 17:44:15.722810 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO dbcounter [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Registered counter for database nova_cell0 Jun 30 17:44:15.723616 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG oslo_db.sqlalchemy.engines [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:44:15.728035 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writer thread running {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:44:15.731932 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_db.sqlalchemy.engines [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:44:15.736201 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writer thread running {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:44:16.084540 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: WARNING keystonemiddleware.auth_token [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 17:44:16.091772 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: WARNING keystonemiddleware.auth_token [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 17:44:16.161435 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: WARNING keystonemiddleware.auth_token [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 17:44:16.172510 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: WARNING keystonemiddleware.auth_token [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 17:44:16.426296 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: WARNING keystonemiddleware.auth_token [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 17:44:16.432225 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: WARNING keystonemiddleware.auth_token [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 17:44:16.437465 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f070639c0 pid: 114864 (default app) Jun 30 17:44:16.439784 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:44:16.440959 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Jun 30 17:44:16.441373 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Thu Jun 30 17:44:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:44:16.608245 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: WARNING keystonemiddleware.auth_token [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 17:44:16.614153 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: WARNING keystonemiddleware.auth_token [None req-799954bb-39bc-41b1-b170-a4b3ceead26b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 17:44:16.619577 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f070639c0 pid: 114865 (default app) Jun 30 17:45:30.278424 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:30.279503 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Jun 30 17:45:30.279908 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:45:30.292350 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writing DB stats nova_api:SELECT=3 {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:45:30.294423 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writing DB stats nova_cell1:SELECT=3 {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:45:30.295721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writing DB stats nova_cell0:SELECT=3 {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:45:30.296820 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:45:30.721199 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-044ec6b4-6e76-4268-8ff2-04d8beb10710 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:30.756334 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-044ec6b4-6e76-4268-8ff2-04d8beb10710 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469090 Jun 30 17:45:30.757070 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jun 30 17:45:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:45:32.872098 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:32.873105 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-78af0570-3abb-489c-9d3f-4e765fbf343e None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 30 17:45:32.873756 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:45:32.932858 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-72a2d608-ca5c-414b-83c8-80c19b2db0bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:32.952333 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 17:45:32.952333 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: warnings.warn(msg) Jun 30 17:45:32.984087 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-72a2d608-ca5c-414b-83c8-80c19b2db0bc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104404 Jun 30 17:45:32.990004 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:45:33.000411 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_api:SELECT=3 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:45:33.001679 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_cell1:SELECT=3 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:45:33.002429 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_cell0:SELECT=3 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:45:33.003150 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:45:33.208508 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-0c876b07-5f48-43b4-9565-ef528aef8acb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:33.210867 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 17:45:33.210867 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: warnings.warn(msg) Jun 30 17:45:33.273789 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-0c876b07-5f48-43b4-9565-ef528aef8acb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280448 Jun 30 17:45:33.274599 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 17:45:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:45:35.335402 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-72a2d608-ca5c-414b-83c8-80c19b2db0bc admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:35.337082 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-72a2d608-ca5c-414b-83c8-80c19b2db0bc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002460 Jun 30 17:45:35.337991 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:45:35.457273 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-c894930c-5a11-4ced-9fe1-80fd046cfecd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "ram": 512}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:35.475802 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 17:45:35.475802 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: warnings.warn(msg) Jun 30 17:45:35.492869 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-c894930c-5a11-4ced-9fe1-80fd046cfecd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145050 Jun 30 17:45:35.493410 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:45:35.505163 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-918b1fbd-12df-496b-ab88-4d28dc50f2d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:35.506659 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 17:45:35.506659 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: warnings.warn(msg) Jun 30 17:45:35.538109 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-918b1fbd-12df-496b-ab88-4d28dc50f2d5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036619 Jun 30 17:45:35.539031 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 17:45:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:45:37.619961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-c894930c-5a11-4ced-9fe1-80fd046cfecd admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:37.620978 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-c894930c-5a11-4ced-9fe1-80fd046cfecd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 30 17:45:37.621951 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:45:37.685042 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c03f4532-22a9-4129-9f8a-573ea46c2524 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G"}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:37.704598 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-c03f4532-22a9-4129-9f8a-573ea46c2524 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076958 Jun 30 17:45:37.705141 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 17:45:37.718425 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-cdac9ff8-ed68-49c5-aac3-0193d00afa04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:37.742013 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-cdac9ff8-ed68-49c5-aac3-0193d00afa04 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027322 Jun 30 17:45:37.754358 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 17:45:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:45:39.827390 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c03f4532-22a9-4129-9f8a-573ea46c2524 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:39.828543 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-c03f4532-22a9-4129-9f8a-573ea46c2524 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Jun 30 17:45:39.829023 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:45:39.886961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-4e6c1266-3cc1-44dc-9009-8ea9c2493ed9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "disk": 10}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:39.904942 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-4e6c1266-3cc1-44dc-9009-8ea9c2493ed9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070119 Jun 30 17:45:39.905424 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 17:45:39.917576 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-484ea917-9c4d-4084-84a2-80c1102b7ffc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:39.945057 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-484ea917-9c4d-4084-84a2-80c1102b7ffc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030805 Jun 30 17:45:39.946746 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 17:45:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:45:42.029974 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-4e6c1266-3cc1-44dc-9009-8ea9c2493ed9 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:42.031020 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-4e6c1266-3cc1-44dc-9009-8ea9c2493ed9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Jun 30 17:45:42.031620 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:45:42.090594 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-72e80c71-6892-485f-a2ac-bd8f003c8297 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:42.108917 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-72e80c71-6892-485f-a2ac-bd8f003c8297 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070726 Jun 30 17:45:42.116778 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 17:45:42.122379 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-6cb7b3e2-2085-4a5c-8f78-db54d56032b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:42.144041 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-6cb7b3e2-2085-4a5c-8f78-db54d56032b5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025980 Jun 30 17:45:42.144592 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Thu Jun 30 17:45:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:45:44.290633 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-72e80c71-6892-485f-a2ac-bd8f003c8297 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:44.291636 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-72e80c71-6892-485f-a2ac-bd8f003c8297 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 30 17:45:44.292029 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:45:44.352368 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-0cf78874-00d8-4438-800e-83ff48c1f6c4 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:44.378003 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-0cf78874-00d8-4438-800e-83ff48c1f6c4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080024 Jun 30 17:45:44.378898 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jun 30 17:45:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:45:46.531916 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-72e80c71-6892-485f-a2ac-bd8f003c8297 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:46.532989 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-72e80c71-6892-485f-a2ac-bd8f003c8297 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Jun 30 17:45:46.533405 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:45:46.596703 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-b5b7fa1b-0092-44ae-b4d5-1e2b17dbcdda admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "1"}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:46.614851 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-b5b7fa1b-0092-44ae-b4d5-1e2b17dbcdda admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073684 Jun 30 17:45:46.615407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:45:46.627462 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-0e08c21e-d93d-4549-9834-7cc96d77f0d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:46.651316 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-0e08c21e-d93d-4549-9834-7cc96d77f0d7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027490 Jun 30 17:45:46.651898 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 17:45:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:45:48.767122 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-b5b7fa1b-0092-44ae-b4d5-1e2b17dbcdda admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:48.768131 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-b5b7fa1b-0092-44ae-b4d5-1e2b17dbcdda admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 30 17:45:48.768533 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:45:48.831994 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-793ee1b1-d355-4b80-9490-6eaaa75be4af admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:48.849757 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-793ee1b1-d355-4b80-9490-6eaaa75be4af admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073278 Jun 30 17:45:48.850317 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 17:45:48.863747 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-20a809f0-3668-4608-a161-82cd103eb188 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:48.889349 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-20a809f0-3668-4608-a161-82cd103eb188 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030257 Jun 30 17:45:48.889936 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 17:45:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:45:50.986182 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-793ee1b1-d355-4b80-9490-6eaaa75be4af admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:50.987258 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-793ee1b1-d355-4b80-9490-6eaaa75be4af admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jun 30 17:45:50.987973 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:45:51.047022 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-027a35e0-2a84-4656-bd3a-061232cab3d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:51.067061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-027a35e0-2a84-4656-bd3a-061232cab3d9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072984 Jun 30 17:45:51.067732 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:45:51.083496 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-ea7687a2-0f86-42d6-9301-7803c6e614a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:51.110663 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-ea7687a2-0f86-42d6-9301-7803c6e614a1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031890 Jun 30 17:45:51.111583 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 17:45:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:45:53.197404 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-027a35e0-2a84-4656-bd3a-061232cab3d9 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:53.198458 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-027a35e0-2a84-4656-bd3a-061232cab3d9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 30 17:45:53.198848 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:45:53.256588 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-e73396da-ea28-4fa9-a7ff-15fa7b3fb05e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "swap": 0}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:53.275329 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-e73396da-ea28-4fa9-a7ff-15fa7b3fb05e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070051 Jun 30 17:45:53.275889 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 17:45:53.289019 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-44508c23-dcc1-4443-9456-53dd2b652e23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:53.315493 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-44508c23-dcc1-4443-9456-53dd2b652e23 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031051 Jun 30 17:45:53.316069 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 17:45:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:45:55.402487 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-e73396da-ea28-4fa9-a7ff-15fa7b3fb05e admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:45:55.404033 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-e73396da-ea28-4fa9-a7ff-15fa7b3fb05e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Jun 30 17:45:55.404426 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:45:55.463829 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-a9a033e4-2365-4807-a756-a9f6560f325b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "id": "5", "swap": 0, "disk": 160}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:55.486286 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-a9a033e4-2365-4807-a756-a9f6560f325b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075885 Jun 30 17:45:55.487100 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Thu Jun 30 17:45:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:45:55.498930 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-5eadb15c-155a-4f08-bbfe-a7e4935d0c34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:45:55.520783 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-5eadb15c-155a-4f08-bbfe-a7e4935d0c34 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025497 Jun 30 17:45:55.521357 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Thu Jun 30 17:45:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:46:21.363012 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-a9a033e4-2365-4807-a756-a9f6560f325b admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:21.364007 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-a9a033e4-2365-4807-a756-a9f6560f325b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 30 17:46:21.364394 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:46:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:46:21.375463 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:46:21.423054 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-dd756084-432d-4661-a0ba-1eb2e0a87af3 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:21.440317 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-dd756084-432d-4661-a0ba-1eb2e0a87af3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070078 Jun 30 17:46:21.440859 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jun 30 17:46:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:46:22.358580 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-a9a033e4-2365-4807-a756-a9f6560f325b admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:22.359563 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-a9a033e4-2365-4807-a756-a9f6560f325b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 30 17:46:22.359954 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:46:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:46:22.547472 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-56ca7630-4d23-4d6a-8698-23bb248a328e admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:22.552979 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.wsgi [None req-56ca7630-4d23-4d6a-8698-23bb248a328e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-56ca7630-4d23-4d6a-8698-23bb248a328e admin admin] Request method failure captured: Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Accept: application/json Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Accept-Encoding: gzip, deflate Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Connection: keep-alive Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Content-Length: 0 Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Host: 10.222.0.16 Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Openstack-Api-Version: compute 2.90 Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Openstack-System-Scope: None Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: User-Agent: python-novaclient Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Auth-Token: gAAAAABiveFuCSIOcgvInRl6ueodxUxaJoUNWEcUlDgKgi4qf4UehBloGpJ_Zkj4AqMX0TVKD_UsSWXgSfpE8M8t0Ft1mWOwjetL7vlMT94ZE-LKHthSjbVvEho44l9cx3E9V_7VEwA7zH8ZUMbU_pHnAgHgyeJCkVOjjcSi9hswRGj2d9q3LGc Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Domain-Id: None Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Domain-Name: None Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Identity-Status: Confirmed Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Is-Admin-Project: True Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Domain-Id: default Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Domain-Name: Default Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Name: admin Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Role: reader,admin,member Jun 30 17:46:22.556231 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Roles: reader,admin,member Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}] Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Tenant: admin Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Tenant-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Tenant-Name: admin Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User: admin Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Domain-Id: default Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Domain-Name: Default Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Id: 5c7b0226fd854776bbee2a2d0d0ee93a Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Name: admin Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: method: > Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: exception: Flavor 42 could not be found. Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: action_args: {'id': '42'} Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:46:22.557811 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:22.558887 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.560262 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-56ca7630-4d23-4d6a-8698-23bb248a328e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:46:22.562016 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-56ca7630-4d23-4d6a-8698-23bb248a328e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060639 Jun 30 17:46:22.562016 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jun 30 17:46:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 17:46:22.567982 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-16e55766-7011-4f2d-9a07-29fbc162ca2d admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:22.571017 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:46:22.590591 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-16e55766-7011-4f2d-9a07-29fbc162ca2d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026352 Jun 30 17:46:22.591114 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 17:46:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:46:22.600613 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-754309c9-9f6a-4c23-a5eb-3bde31e768d9 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:22.621876 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-754309c9-9f6a-4c23-a5eb-3bde31e768d9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024823 Jun 30 17:46:22.622409 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 17:46:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:46:22.632529 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-7d7ad941-ff28-450c-b9b1-a5b9abe24745 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:22.638682 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.wsgi [None req-7d7ad941-ff28-450c-b9b1-a5b9abe24745 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-7d7ad941-ff28-450c-b9b1-a5b9abe24745 admin admin] Request method failure captured: Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Accept: application/json Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Accept-Encoding: gzip, deflate Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Connection: keep-alive Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Content-Length: 0 Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Host: 10.222.0.16 Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Openstack-Api-Version: compute 2.90 Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Openstack-System-Scope: None Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: User-Agent: python-novaclient Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Auth-Token: gAAAAABiveFuCSIOcgvInRl6ueodxUxaJoUNWEcUlDgKgi4qf4UehBloGpJ_Zkj4AqMX0TVKD_UsSWXgSfpE8M8t0Ft1mWOwjetL7vlMT94ZE-LKHthSjbVvEho44l9cx3E9V_7VEwA7zH8ZUMbU_pHnAgHgyeJCkVOjjcSi9hswRGj2d9q3LGc Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Domain-Id: None Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Domain-Name: None Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Identity-Status: Confirmed Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Is-Admin-Project: True Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Domain-Id: default Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Domain-Name: Default Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Name: admin Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Role: reader,admin,member Jun 30 17:46:22.641901 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Roles: reader,admin,member Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}] Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Tenant: admin Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Tenant-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Tenant-Name: admin Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User: admin Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Domain-Id: default Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Domain-Name: Default Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Id: 5c7b0226fd854776bbee2a2d0d0ee93a Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Name: admin Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: method: > Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: exception: Flavor 42 could not be found. Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: action_args: {'id': '42'} Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:46:22.643473 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:22.644621 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:22.645714 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-7d7ad941-ff28-450c-b9b1-a5b9abe24745 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:46:22.646728 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-7d7ad941-ff28-450c-b9b1-a5b9abe24745 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014823 Jun 30 17:46:22.646728 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jun 30 17:46:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 30 17:46:23.458447 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-754309c9-9f6a-4c23-a5eb-3bde31e768d9 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:23.459451 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-754309c9-9f6a-4c23-a5eb-3bde31e768d9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 30 17:46:23.459843 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:46:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:46:23.651627 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-ff1e01be-8761-46e8-9c53-54dc926d8879 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:23.658032 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.wsgi [None req-ff1e01be-8761-46e8-9c53-54dc926d8879 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-ff1e01be-8761-46e8-9c53-54dc926d8879 admin admin] Request method failure captured: Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Accept: application/json Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Accept-Encoding: gzip, deflate Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Connection: keep-alive Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Content-Length: 0 Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Host: 10.222.0.16 Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Openstack-Api-Version: compute 2.90 Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Openstack-System-Scope: None Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: User-Agent: python-novaclient Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Auth-Token: gAAAAABiveFvvzlfdeCQqUB3vc-L0OBNu-rjhZdcxGVNRIfHp--q0ISq8yIZ7_81P1FFi_kpDSbvaSkiWSSFB2_a23L5aBn1irmbq6HuFTJv-_DidA4nLpnGLjQMV2qMc_m90zt9noQPktaopM7QlQdZoTLuRhlPzf44gWfzwLOzYdMignfWSYA Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Domain-Id: None Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Domain-Name: None Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Identity-Status: Confirmed Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Is-Admin-Project: True Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Domain-Id: default Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Domain-Name: Default Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Name: admin Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Role: reader,admin,member Jun 30 17:46:23.659561 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Roles: reader,admin,member Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}] Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Tenant: admin Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Tenant-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Tenant-Name: admin Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User: admin Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Domain-Id: default Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Domain-Name: Default Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Id: 5c7b0226fd854776bbee2a2d0d0ee93a Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Name: admin Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: method: > Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: exception: Flavor 84 could not be found. Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: action_args: {'id': '84'} Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:46:23.661961 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:23.663044 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.664359 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-ff1e01be-8761-46e8-9c53-54dc926d8879 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:46:23.665633 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-ff1e01be-8761-46e8-9c53-54dc926d8879 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061036 Jun 30 17:46:23.665633 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jun 30 17:46:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 17:46:23.671926 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-bef1c409-db4e-4f3c-ad8a-8331ac5926b5 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:23.688149 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-bef1c409-db4e-4f3c-ad8a-8331ac5926b5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020442 Jun 30 17:46:23.688662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 17:46:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:46:23.698124 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-f45a9ec3-7fe6-4325-9200-3bfd6ed5375a admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:23.713865 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-f45a9ec3-7fe6-4325-9200-3bfd6ed5375a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019247 Jun 30 17:46:23.714417 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 17:46:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:46:23.723532 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c60cc639-d9fc-4122-94e3-641444502ed2 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:23.729600 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.wsgi [None req-c60cc639-d9fc-4122-94e3-641444502ed2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c60cc639-d9fc-4122-94e3-641444502ed2 admin admin] Request method failure captured: Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Accept: application/json Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Accept-Encoding: gzip, deflate Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Connection: keep-alive Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Content-Length: 0 Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Host: 10.222.0.16 Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Openstack-Api-Version: compute 2.90 Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Openstack-System-Scope: None Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: User-Agent: python-novaclient Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Auth-Token: gAAAAABiveFvvzlfdeCQqUB3vc-L0OBNu-rjhZdcxGVNRIfHp--q0ISq8yIZ7_81P1FFi_kpDSbvaSkiWSSFB2_a23L5aBn1irmbq6HuFTJv-_DidA4nLpnGLjQMV2qMc_m90zt9noQPktaopM7QlQdZoTLuRhlPzf44gWfzwLOzYdMignfWSYA Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Domain-Id: None Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Domain-Name: None Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Identity-Status: Confirmed Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Is-Admin-Project: True Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Domain-Id: default Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Domain-Name: Default Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Name: admin Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Role: reader,admin,member Jun 30 17:46:23.731144 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Roles: reader,admin,member Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}] Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Tenant: admin Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Tenant-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Tenant-Name: admin Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User: admin Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Domain-Id: default Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Domain-Name: Default Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Id: 5c7b0226fd854776bbee2a2d0d0ee93a Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Name: admin Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: method: > Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: exception: Flavor 84 could not be found. Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: action_args: {'id': '84'} Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:46:23.732662 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:23.733681 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:23.735034 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c60cc639-d9fc-4122-94e3-641444502ed2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:46:23.736334 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-c60cc639-d9fc-4122-94e3-641444502ed2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012459 Jun 30 17:46:23.736334 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Jun 30 17:46:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 17:46:24.551252 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-f45a9ec3-7fe6-4325-9200-3bfd6ed5375a admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:24.552262 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-f45a9ec3-7fe6-4325-9200-3bfd6ed5375a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 30 17:46:24.552654 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:46:24.745444 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-1fa19174-ecd9-4d13-b0fc-256cf10b10c2 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:24.751219 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.wsgi [None req-1fa19174-ecd9-4d13-b0fc-256cf10b10c2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-1fa19174-ecd9-4d13-b0fc-256cf10b10c2 admin admin] Request method failure captured: Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Accept: application/json Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Accept-Encoding: gzip, deflate Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Connection: keep-alive Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Content-Length: 0 Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Host: 10.222.0.16 Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Openstack-Api-Version: compute 2.90 Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Openstack-System-Scope: None Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: User-Agent: python-novaclient Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Auth-Token: gAAAAABiveFwuu1IIBBDojZLiVTgoKF6TJtzcmVursD476fZ11jmJ1mvJjobe2-fBXYgt0vLkbsFn5P9tZ3s0U3U-S4x2RrIB2X0P5GGaYgpAr9N5_olrukoed9adQBvyQeNGEokzukq8HF3WukKwJ7jk8fKyrOwXcNiTMHWqZWA2SbxtIIiPKw Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Domain-Id: None Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Domain-Name: None Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Identity-Status: Confirmed Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Is-Admin-Project: True Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Domain-Id: default Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Domain-Name: Default Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Project-Name: admin Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Role: reader,admin,member Jun 30 17:46:24.752721 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Roles: reader,admin,member Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}] Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Tenant: admin Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Tenant-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-Tenant-Name: admin Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User: admin Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Domain-Id: default Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Domain-Name: Default Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Id: 5c7b0226fd854776bbee2a2d0d0ee93a Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: X-User-Name: admin Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: method: > Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: exception: Flavor 451 could not be found. Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: action_args: {'id': '451'} Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:46:24.754271 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:24.755363 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.756498 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-1fa19174-ecd9-4d13-b0fc-256cf10b10c2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:46:24.757535 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-1fa19174-ecd9-4d13-b0fc-256cf10b10c2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060588 Jun 30 17:46:24.757535 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 17:46:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 17:46:24.763787 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-76817d27-f56a-4a76-bcea-aab60eee4aa3 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:24.777560 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-76817d27-f56a-4a76-bcea-aab60eee4aa3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017404 Jun 30 17:46:24.778120 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 17:46:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:46:24.788066 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:24.801945 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017455 Jun 30 17:46:24.802482 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Jun 30 17:46:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:46:24.811390 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-605859c9-7a3d-46e2-8d43-e2480474c8bd admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:24.816717 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.wsgi [None req-605859c9-7a3d-46e2-8d43-e2480474c8bd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-605859c9-7a3d-46e2-8d43-e2480474c8bd admin admin] Request method failure captured: Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Accept: application/json Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Accept-Encoding: gzip, deflate Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Connection: keep-alive Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Content-Length: 0 Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Host: 10.222.0.16 Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Openstack-Api-Version: compute 2.90 Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Openstack-System-Scope: None Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: User-Agent: python-novaclient Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Auth-Token: gAAAAABiveFwuu1IIBBDojZLiVTgoKF6TJtzcmVursD476fZ11jmJ1mvJjobe2-fBXYgt0vLkbsFn5P9tZ3s0U3U-S4x2RrIB2X0P5GGaYgpAr9N5_olrukoed9adQBvyQeNGEokzukq8HF3WukKwJ7jk8fKyrOwXcNiTMHWqZWA2SbxtIIiPKw Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Domain-Id: None Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Domain-Name: None Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Identity-Status: Confirmed Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Is-Admin-Project: True Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Domain-Id: default Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Domain-Name: Default Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Project-Name: admin Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Role: reader,admin,member Jun 30 17:46:24.818510 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Roles: reader,admin,member Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2b7acc57e2754d7ab425d395278a2937"}]}] Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Tenant: admin Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Tenant-Id: 2b7acc57e2754d7ab425d395278a2937 Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-Tenant-Name: admin Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User: admin Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Domain-Id: default Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Domain-Name: Default Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Id: 5c7b0226fd854776bbee2a2d0d0ee93a Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: X-User-Name: admin Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: method: > Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: exception: Flavor 451 could not be found. Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: action_args: {'id': '451'} Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:46:24.820061 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:24.821027 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: ERROR nova.api.openstack.wsgi Jun 30 17:46:24.822407 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-605859c9-7a3d-46e2-8d43-e2480474c8bd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:46:24.823634 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-605859c9-7a3d-46e2-8d43-e2480474c8bd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012021 Jun 30 17:46:24.823634 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 17:46:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 30 17:46:25.642639 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:25.643650 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 30 17:46:25.644049 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:46:25.836355 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-66b09be0-e351-412a-a588-6a37c48335e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:46:25.855171 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-66b09be0-e351-412a-a588-6a37c48335e6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071694 Jun 30 17:46:25.855641 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jun 30 17:46:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 17:46:26.675961 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:26.676997 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 30 17:46:26.677392 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:46:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:46:26.876957 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-454fc424-462a-41cb-b0d2-81fafeb7a7a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:46:26.893856 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-454fc424-462a-41cb-b0d2-81fafeb7a7a4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068864 Jun 30 17:46:26.894341 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jun 30 17:46:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:46:27.715143 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:27.716208 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 30 17:46:27.716604 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:46:27.905353 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-f3558a84-feff-440d-bcb8-e51a08fa47da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:46:27.921996 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-f3558a84-feff-440d-bcb8-e51a08fa47da admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068439 Jun 30 17:46:27.922568 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jun 30 17:46:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:46:28.746282 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:28.747309 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 30 17:46:28.747709 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:46:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:46:28.938907 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-a4091a91-a76e-4ec9-81b2-3e0322c13617 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:46:28.957499 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-a4091a91-a76e-4ec9-81b2-3e0322c13617 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072113 Jun 30 17:46:28.957977 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Jun 30 17:46:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:46:29.769500 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:29.770545 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 30 17:46:29.771175 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:46:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:46:29.962469 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-7118ed92-e211-40a2-b931-3ddab566d12a admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:46:29.981251 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-7118ed92-e211-40a2-b931-3ddab566d12a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071795 Jun 30 17:46:29.981774 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Thu Jun 30 17:46:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:47:16.549757 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:47:16.550817 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-a33220b2-54a1-4bac-b7e1-6bda990b62f2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 30 17:47:16.551277 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Thu Jun 30 17:47:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:47:16.561650 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:47:16.610247 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-a919d3b1-4e9f-4216-9a6f-e7f509ecad6d admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:47:16.630089 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-a919d3b1-4e9f-4216-9a6f-e7f509ecad6d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072945 Jun 30 17:47:16.630652 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Thu Jun 30 17:47:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:47:16.653446 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-5e24c80f-2c02-4160-a23a-a514e6abbb40 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:47:16.656915 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG dbcounter [-] [114865] Writing DB stats nova_api:SELECT=14 {{(pid=114865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:47:16.662361 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-5e24c80f-2c02-4160-a23a-a514e6abbb40 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012460 Jun 30 17:47:16.662898 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Thu Jun 30 17:47:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:47:16.674511 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-98ebaa3c-7599-4196-af88-04d119608cc5 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:47:16.681975 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-98ebaa3c-7599-4196-af88-04d119608cc5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011552 Jun 30 17:47:16.682522 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Thu Jun 30 17:47:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:47:16.694256 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:47:16.701807 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011254 Jun 30 17:47:16.702315 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Thu Jun 30 17:47:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:47:16.712813 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-1279e744-e4f0-4c40-8503-38936c07d738 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:47:16.720149 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-1279e744-e4f0-4c40-8503-38936c07d738 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010665 Jun 30 17:47:16.720647 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Thu Jun 30 17:47:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:50:44.807215 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:50:44.808220 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 30 17:50:44.808671 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:50:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:50:44.957224 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_api:SELECT=6 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:50:45.070741 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-a4142833-766f-4534-a281-2846c9305ada admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:50:45.071952 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 17:50:45.071952 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: warnings.warn(msg) Jun 30 17:50:45.073145 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-a4142833-766f-4534-a281-2846c9305ada admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:50:45.073578 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-a4142833-766f-4534-a281-2846c9305ada admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:50:45.074650 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-a4142833-766f-4534-a281-2846c9305ada admin admin] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:50:45.075075 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-a4142833-766f-4534-a281-2846c9305ada admin admin] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:50:45.108432 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-a4142833-766f-4534-a281-2846c9305ada admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.152570 Jun 30 17:50:45.108981 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 17:50:44 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:50:46.002143 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:50:46.003279 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jun 30 17:50:46.003825 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:50:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:50:46.194927 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-5dd9940f-3d40-4d86-bd2b-a41c0ed75eb9 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:50:46.196094 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 17:50:46.196094 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: warnings.warn(msg) Jun 30 17:50:46.197300 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-5dd9940f-3d40-4d86-bd2b-a41c0ed75eb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:50:46.197736 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-5dd9940f-3d40-4d86-bd2b-a41c0ed75eb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:50:46.198549 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-5dd9940f-3d40-4d86-bd2b-a41c0ed75eb9 admin admin] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:50:46.198974 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-5dd9940f-3d40-4d86-bd2b-a41c0ed75eb9 admin admin] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:50:46.218848 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-5dd9940f-3d40-4d86-bd2b-a41c0ed75eb9 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074690 Jun 30 17:50:46.219329 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 17:50:46 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:50:57.463608 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:50:57.464629 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 30 17:50:57.465026 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:50:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:50:57.608674 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_cell0:SELECT=4 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:50:57.609383 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_cell1:SELECT=4 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:50:57.609982 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG dbcounter [-] [114864] Writing DB stats nova_api:SELECT=8 {{(pid=114864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:50:57.658113 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-c70055ea-1e34-43d5-a506-2d375bfa2fce admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:50:57.659299 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 17:50:57.659299 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: warnings.warn(msg) Jun 30 17:50:57.660470 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-c70055ea-1e34-43d5-a506-2d375bfa2fce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:50:57.660929 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-c70055ea-1e34-43d5-a506-2d375bfa2fce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:50:57.661705 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-c70055ea-1e34-43d5-a506-2d375bfa2fce admin admin] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:50:57.662125 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-c70055ea-1e34-43d5-a506-2d375bfa2fce admin admin] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:50:57.686227 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-c70055ea-1e34-43d5-a506-2d375bfa2fce admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.081900 Jun 30 17:50:57.686727 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 17:50:57 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:50:58.507714 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: DEBUG nova.api.openstack.wsgi [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] Calling method '>' {{(pid=114865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:50:58.512215 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: INFO nova.api.openstack.requestlog [None req-c4b3be38-35a8-41af-9f9b-7cc918ed6f50 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 30 17:50:58.513744 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: [pid: 114865|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Jun 30 17:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:50:58.706016 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG nova.api.openstack.wsgi [None req-246c4112-f569-4972-8a37-8ea4bb5075d9 admin admin] Calling method '>' {{(pid=114864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:50:58.707227 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 17:50:58.707227 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: warnings.warn(msg) Jun 30 17:50:58.708441 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-246c4112-f569-4972-8a37-8ea4bb5075d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:50:58.708911 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-246c4112-f569-4972-8a37-8ea4bb5075d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:50:58.709720 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-246c4112-f569-4972-8a37-8ea4bb5075d9 admin admin] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:50:58.710150 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: DEBUG oslo_concurrency.lockutils [None req-246c4112-f569-4972-8a37-8ea4bb5075d9 admin admin] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:50:58.732964 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: INFO nova.api.openstack.requestlog [None req-246c4112-f569-4972-8a37-8ea4bb5075d9 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080589 Jun 30 17:50:58.733454 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: [pid: 114864|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Jun 30 17:50:58 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:51:55.528354 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: Thu Jun 30 17:51:55 2022 - graceful shutdown triggered... Jun 30 17:51:55.528082 dv-cinder-812685-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 30 17:51:55.529316 dv-cinder-812685-15-iscsi devstack@n-api.service[114864]: Gracefully killing worker 1 (pid: 114864)... Jun 30 17:51:55.529697 dv-cinder-812685-15-iscsi devstack@n-api.service[114865]: Gracefully killing worker 2 (pid: 114865)... Jun 30 17:51:56.529096 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: worker 1 buried after 1 seconds Jun 30 17:51:56.529638 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: worker 2 buried after 1 seconds Jun 30 17:51:56.529638 dv-cinder-812685-15-iscsi devstack@n-api.service[114863]: goodbye to uWSGI. Jun 30 17:51:56.530725 dv-cinder-812685-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 30 17:51:56.531268 dv-cinder-812685-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 30 17:51:56.534098 dv-cinder-812685-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 17:51:56.545338 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 17:51:56 2022] *** Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: nodename: dv-cinder-812685-15-iscsi Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: machine: x86_64 Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: clock source: unix Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: pcre jit disabled Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: detected number of CPU cores: 4 Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: current working directory: / Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: detected binary path: /usr/bin/uwsgi-core Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: your processes number limit is 47680 Jun 30 17:51:56.547987 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: your memory page size is 4096 bytes Jun 30 17:51:56.548811 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: detected max file descriptor number: 2048 Jun 30 17:51:56.548811 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: lock engine: pthread robust mutexes Jun 30 17:51:56.548811 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: thunder lock: enabled Jun 30 17:51:56.548811 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 17:51:56.548811 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 17:51:56.595827 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: Python main interpreter initialized at 0x557cdf2a09c0 Jun 30 17:51:56.595827 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: python threads support enabled Jun 30 17:51:56.595827 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: your server socket listen backlog is limited to 100 connections Jun 30 17:51:56.595827 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: your mercy for graceful operations on workers is 90 seconds Jun 30 17:51:56.596276 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 17:51:56.596276 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: *** Operational MODE: preforking *** Jun 30 17:51:56.596573 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: *** uWSGI is running in multiple interpreter mode *** Jun 30 17:51:56.596573 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: spawned uWSGI master process (pid: 129349) Jun 30 17:51:56.596773 dv-cinder-812685-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 17:51:56.610398 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: spawned uWSGI worker 1 (pid: 129370, cores: 1) Jun 30 17:51:56.610398 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: spawned uWSGI worker 2 (pid: 129371, cores: 1) Jun 30 17:51:56.610398 dv-cinder-812685-15-iscsi devstack@n-api.service[129349]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 17:51:57.262734 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 17:51:57.273742 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 17:51:58.466001 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 17:51:58.466001 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: from cryptography.utils import int_from_bytes Jun 30 17:51:58.466715 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 17:51:58.466715 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: from cryptography.utils import int_from_bytes Jun 30 17:51:58.478274 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 17:51:58.478274 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: from cryptography.utils import int_from_bytes Jun 30 17:51:58.478877 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 17:51:58.478877 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: from cryptography.utils import int_from_bytes Jun 30 17:52:00.905757 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 17:52:00.906356 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 17:52:00.907083 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 17:52:00.907083 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 17:52:00.907402 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 17:52:00.907753 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.908068 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.908387 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.908706 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.909037 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.909349 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.909688 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.909988 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.910399 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.910615 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.910958 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.911269 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-15-iscsi {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.911582 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.911889 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.912238 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.912556 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.912857 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.913177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.913483 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.913969 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.915871 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.915871 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.915871 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.915871 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.916220 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.916220 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.916542 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.916832 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.917148 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.917572 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.917975 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-15-iscsi {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.918221 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.918595 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.918911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.919481 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.919749 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.920034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.920444 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.920686 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.921027 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.921415 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.921545 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 17:52:00.921996 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 17:52:00.922080 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.922080 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.922273 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 17:52:00.922804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.923145 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 17:52:00.923387 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.923758 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 17:52:00.923905 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924029 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924155 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924457 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924541 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924742 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924817 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924903 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.924977 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.925057 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.925136 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.925254 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.925406 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.925514 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.925601 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.925683 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.925899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.926016 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.926289 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.926436 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.926523 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.926599 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-15-iscsi {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.926732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.927169 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.927277 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.927362 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.927438 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.927517 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.928150 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.928339 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.928556 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.928672 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.928843 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.928940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.929134 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.929255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.929460 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.929711 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.929796 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.930014 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.930107 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.930387 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.930527 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.930661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.930751 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.930983 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.931147 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.931335 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.931486 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.931668 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.931828 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.931982 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.932140 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.932295 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.932509 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.932509 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.932888 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.932888 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.933178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.933178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.933482 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-15-iscsi {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.933661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.933815 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.933966 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.934133 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.934285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.934457 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.934631 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.934778 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.934933 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.935083 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.935235 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.935375 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.935552 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.935728 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.935881 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.936114 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.936351 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.936351 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.936649 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.936805 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.936960 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.937405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.937606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.937792 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.937936 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.938095 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.938236 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.938394 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.938562 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.938746 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.938910 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.939132 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.939282 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.939432 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.939701 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.939874 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.940018 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.940172 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.940323 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.940465 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.940612 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.940771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.940943 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.941214 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.941359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.941501 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.941642 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.941824 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.941981 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.942126 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.942276 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.942503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.942675 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.942842 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.944479 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.944644 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.944790 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.944935 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.945077 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.945237 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.945380 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.945529 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.945681 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.945868 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.946022 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.946241 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.946571 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.946760 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.946916 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.946916 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.947217 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.947728 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.947890 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.948061 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.948222 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.948365 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.948514 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.948664 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.948827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.948986 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.949400 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.949673 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.949934 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.949934 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.950164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.950251 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.950354 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.950354 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.950559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.950559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.950747 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.950747 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.950939 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951013 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951085 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951165 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951263 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951354 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951435 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951514 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951595 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951788 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951882 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.951882 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.952031 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.952154 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.952246 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.952320 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.952405 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.952479 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.952559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.952559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.952701 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.962994 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.963293 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.963484 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.963656 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.963817 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.964009 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.964292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.964478 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.964633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.964826 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.964988 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.965136 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.965291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.965452 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.965599 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.965747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.965919 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.966067 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.966222 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.966400 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.966565 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.966722 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.966876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.967067 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.967230 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.967384 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.967532 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.967678 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.967844 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.968034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.968196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.968343 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.968504 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.968652 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.968808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.968987 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.969370 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.969527 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.969690 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.969838 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.969985 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.970157 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.970314 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.970499 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.970668 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.970824 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.970973 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.971121 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.971269 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.971415 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.971570 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.971724 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.971879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.972276 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.972452 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.972609 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.972991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.973241 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.973404 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.973552 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.973705 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.973861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.974024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.974180 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.974412 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.974588 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.974763 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.974921 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.975127 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.975372 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.975549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.975699 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.975854 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.976010 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.976200 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.976352 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.976509 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.976656 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.976802 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.976973 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.977122 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.977270 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.977430 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.977586 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.977985 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.978150 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.978316 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.978590 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.978830 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.979070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.979722 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.979992 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.980318 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.980567 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.980822 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.981112 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.981353 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.981584 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.981842 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 17:52:00.982103 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.982883 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.983720 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.983958 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.984210 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.984210 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.984710 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.985173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.985420 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.985583 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.985753 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.985906 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.986055 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.986250 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.986584 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.986753 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.986982 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.987147 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.987307 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.987454 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.987600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.987757 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.987920 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.988068 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.988416 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.988647 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.988800 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.988996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.989195 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.989395 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.989863 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.990041 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.990768 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.990935 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.997072 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.997870 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.998033 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.998200 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.998395 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.998564 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.998724 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.998873 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.999027 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.999197 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.999356 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.999667 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:00.999667 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.000240 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.000391 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.000555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.000747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.000904 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.001060 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.001210 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.001358 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.001514 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.001716 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.001911 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.002070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.002196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.002312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.002763 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.002935 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.003085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.003240 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.003388 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.003543 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.003780 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.003950 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.004098 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.004253 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.004401 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.004600 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.005024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.005440 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.005641 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.006378 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.006581 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.006942 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.007116 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.007267 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.007434 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.007583 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.007739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.007961 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.008117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.008272 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.008426 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.008574 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.008722 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.008885 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.009067 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.009223 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.009378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.009545 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.009702 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.009891 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.010277 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.010454 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.010590 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.010755 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.010907 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.011072 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.011215 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.011359 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.011493 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.011633 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.011803 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.011970 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.012112 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.012253 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.012385 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.012525 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.012667 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.012856 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.012992 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.013133 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.013274 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.013417 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.013550 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.013688 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.013829 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.014041 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.014191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.014359 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.014508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.014651 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.014792 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.015206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.015599 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.015748 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.015883 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.016073 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.016211 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.016344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.016476 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.016623 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.016764 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.016905 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.017039 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.017178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.017318 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.017465 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.017607 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.017746 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.017887 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.018063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.018213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.018364 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.018498 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.018643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.018784 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.018924 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.019145 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.019317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.019451 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.019593 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.019726 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.019867 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.020012 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.020412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.020603 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.020737 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.020877 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.021010 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.021152 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.021287 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.021445 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.021584 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.021725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.021867 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.022000 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.022140 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.031954 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.032140 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.032285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.032449 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.032590 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.032726 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.032869 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.033005 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.033147 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.033291 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.033426 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.033559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.033698 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.033833 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.033965 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.034107 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.034256 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.034434 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.034578 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.034721 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.034870 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.035004 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.035143 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.035277 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.035469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.035733 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.035880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.036020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.036152 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.036292 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.036425 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.036557 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.036699 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.036840 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.037905 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.038055 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.038306 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.038665 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.038823 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.038968 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.039113 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.039248 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.039446 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.039593 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.039593 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.039852 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.039994 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.040141 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.040344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.040497 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.040729 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.040874 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.041019 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.041155 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.041294 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.041454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.041709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.041939 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.041939 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.042389 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.042533 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.042682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.042816 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.042955 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.043088 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.043229 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.043369 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.043547 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.043692 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.043826 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.043966 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.044099 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.044246 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.044381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.044522 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.044654 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.044787 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.044926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.045148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.045293 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.045435 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.045572 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.045714 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.045855 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.045998 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.046139 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.046279 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.046441 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.046576 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.046708 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.046854 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.046987 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047119 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047251 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047383 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047569 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047710 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047850 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047990 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047990 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047990 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.047990 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.048673 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.048817 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.048817 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.049069 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.049209 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.049209 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.049483 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.049626 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.049765 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.049898 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.049898 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.050176 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.050325 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.050325 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.050815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.050963 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.050963 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.051244 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.051385 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.051546 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.051833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.051833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.051833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.051833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.051833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.053240 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.053375 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.053517 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.053663 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.053663 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.053931 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.054072 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.054072 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.054323 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.054497 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.054632 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.054773 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.054773 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.054773 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.054773 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.055275 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.055424 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.055604 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.055739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.055739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.056136 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.056281 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.056281 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.056541 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.056682 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.056815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.056958 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.056958 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.057208 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.057348 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.057490 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.057630 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.057630 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.057895 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.058027 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.058027 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.058292 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.058292 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.058712 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.058912 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.059068 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.059827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.059984 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.060135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.060270 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.060410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.060566 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.060770 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.061004 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.061144 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.061261 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.061390 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.061523 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.061655 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.061909 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.062076 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.062290 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.062692 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.062851 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.062987 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.063135 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.063279 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.063594 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.063734 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.063876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.063876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.063876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.064263 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.064398 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.064538 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.064679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.064814 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.064814 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.065079 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.065213 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.065213 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.065473 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.065607 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.065753 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.065887 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.066034 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.066247 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.066411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.066411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.066688 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.066821 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.066954 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.067087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.067219 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.067362 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.067497 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.067719 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.067860 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.068003 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.068003 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.068836 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.069129 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.069129 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.069402 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.069539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.069672 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.069812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.069812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.070072 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.070214 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.070214 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.070533 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.070678 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.070678 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.071136 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.071282 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.071424 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.071567 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.071567 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.071847 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.072001 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.072226 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.072452 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.072452 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.073081 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.073223 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.073376 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.073518 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.073660 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.073754 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.073837 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.074093 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.074468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.074547 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.074547 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.074687 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.074769 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.074859 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075010 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075010 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075167 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075248 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075335 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075420 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075420 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075599 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075847 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075942 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.075942 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076124 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076238 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076426 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076426 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076599 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076694 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076782 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076874 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.076874 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077048 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077147 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077147 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077311 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077405 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077491 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077584 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077584 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077759 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077846 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.077846 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078009 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078104 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078198 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078459 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078545 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078545 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078724 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078811 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078995 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.078995 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.079276 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.079365 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.079450 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.079536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.079536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.079536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.079536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.079536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.079536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080140 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080236 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080236 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080498 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080498 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080670 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080757 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.080961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081056 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081162 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081162 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081321 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081421 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081421 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081579 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081672 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081766 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081859 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.081859 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082115 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082115 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082298 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082623 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082710 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082803 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082891 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.082891 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.083246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.083335 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.083335 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.083500 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.083596 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.083715 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.083804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.083804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084003 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084275 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084275 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084441 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084631 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084726 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084813 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084899 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.084899 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085087 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085182 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085182 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085349 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085442 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085442 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085608 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085695 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085795 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085883 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.085883 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086049 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086143 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086231 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086345 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086345 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086510 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086693 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086785 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086785 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.086953 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087039 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087039 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087195 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087294 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087294 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087648 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087782 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087782 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.087967 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088219 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088307 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088406 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088493 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088493 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088656 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088743 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088828 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.088923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089079 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089180 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089180 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089353 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089436 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089436 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089591 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089684 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089786 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089887 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.089887 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090045 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090131 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090217 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090302 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090465 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090551 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090646 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090741 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090741 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.090908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091008 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091008 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091155 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091240 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091421 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091516 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091603 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091696 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091784 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091876 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.091972 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092067 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092161 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092248 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092334 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092518 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092605 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092686 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092780 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092867 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.092961 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093270 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093342 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093427 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093525 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093613 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093711 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093798 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.093970 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094065 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094065 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094229 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094315 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094415 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094415 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094589 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094589 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094747 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094832 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.094926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095012 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095107 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095194 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095279 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095372 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095464 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095646 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095774 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.095965 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096058 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096058 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096298 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096394 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096489 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096586 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096674 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096774 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.096949 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097043 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097232 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097333 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097422 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097509 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097602 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097689 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097689 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.097948 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.098035 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.098121 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.098221 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.098322 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.098541 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.098630 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.098728 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.098831 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.098960 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099182 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099267 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099367 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099472 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099586 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099677 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099809 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099887 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.099971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100058 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100142 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100216 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100289 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100362 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100445 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100445 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100592 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100592 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100893 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.100968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101048 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101128 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101208 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101294 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101375 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101533 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101613 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101693 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101693 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101840 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101840 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.101975 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102049 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102120 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102204 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102396 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102473 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102553 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102635 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102709 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102780 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102851 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.102930 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103010 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103176 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103260 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103355 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103436 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103516 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103602 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103676 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103748 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103867 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.103955 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104029 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104111 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104273 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104426 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104512 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104586 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104665 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104744 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104817 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104890 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.104970 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105056 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105130 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105208 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105288 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105362 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105446 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105778 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105860 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.105934 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106014 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106166 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106248 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106373 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106464 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106562 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106645 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106719 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.106994 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107146 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107224 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107315 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107754 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107909 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.107993 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108174 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108275 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108526 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108526 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108526 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108526 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108838 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.108936 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109032 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109119 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109212 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109309 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109403 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109498 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109580 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109838 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.109925 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.110020 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.110107 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.110200 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.110293 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.110409 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.110507 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.110771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.110866 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.111093 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.111199 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.111405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.111510 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.111715 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.111857 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.112024 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.112128 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.112352 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.112462 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.112661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.112755 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.112974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.113068 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.113287 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.113392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.113597 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.113692 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.113972 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.114080 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.114211 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.114305 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.114579 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.114696 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.114887 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.114990 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.115756 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.115855 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.116080 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.116175 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.116402 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.116507 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.116721 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.116826 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.117034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.117137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.117365 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.117474 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.117688 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.117784 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.118003 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.118098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.118322 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.118452 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.118661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.118758 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.118977 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.119073 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.119292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.119399 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.119607 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.119699 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.119916 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.120032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.120229 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.120332 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.120542 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.120651 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.120859 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.120956 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.121175 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.121440 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.121535 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.121779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.121883 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.122103 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.122208 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.122465 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.122579 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.122783 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.122880 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.123102 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.123197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.123419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.123521 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.123737 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.123944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.124061 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.124265 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.124361 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.124600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.124706 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.124929 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.125037 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.125255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.125352 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.125574 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.125670 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.125896 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.126001 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.126226 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.126347 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.126565 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.126674 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.126873 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.126970 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.127188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.127290 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.127498 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.127608 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.127808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.127924 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.128137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.128234 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.128451 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.128557 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.128759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.128856 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.129074 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.129176 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.129383 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.129491 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.129694 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.129924 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.130021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.130285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.130429 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.130636 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.130787 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.131520 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.131617 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.131837 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.131943 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.132152 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.132247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.132479 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.132582 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.132810 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.132919 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.133121 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.133217 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.133432 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.133536 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.133747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.133852 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.134060 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.134159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.134423 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.134618 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.134759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.134936 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.135035 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.135273 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.135367 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.135599 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.135707 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.135912 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.136004 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.136222 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.136316 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.136543 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.136712 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.136850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.136965 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.137162 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.137266 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.137466 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.137575 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.137779 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.137879 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.138088 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.138189 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.138422 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.138535 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.138733 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.138826 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.139041 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.139134 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.139346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.139438 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.139651 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.139745 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.139967 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.140071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.140274 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.140499 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.140594 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.140850 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.140952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.141167 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.141269 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.141503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.141597 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.141832 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.141925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.142141 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.142243 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.142469 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.142578 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.142790 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.142890 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.143097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.143198 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.143405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.143506 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.143725 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.143826 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.144039 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.144140 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.144344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.144456 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.144722 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.144818 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.144950 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.145219 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.145322 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.145553 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.145645 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.145865 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.145971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.146172 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.146274 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.146547 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.146657 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.146859 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.146968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.147182 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.147282 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.147473 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.147566 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.147786 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.147896 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.148093 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.148187 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.148400 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.148493 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.148707 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.148800 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.149012 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.149113 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.149321 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.149414 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.149625 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.149718 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.149935 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.150040 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.150242 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.150370 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.150578 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.150680 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.150883 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.150983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.151194 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.151302 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.151511 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.151605 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.151823 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.151917 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.152141 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.152248 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.152446 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.152538 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.152763 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.152856 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.153077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.153170 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.153403 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.153496 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.153717 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.153816 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.154028 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.154120 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.154400 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.154589 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.154843 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.154935 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.155041 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.155224 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.155332 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.155561 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.155662 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.155923 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.156032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.156193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.156285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.156534 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.156707 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.156844 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.157026 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.157150 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.157352 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.157453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.157679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.157782 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.157994 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.158088 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.158321 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.158433 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.158671 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.158775 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.158984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.159076 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.159294 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.159394 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.159604 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.159705 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.159930 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.160024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.160224 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.160332 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.160531 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.160625 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.160840 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.160932 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.161147 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.161248 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.161463 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.161557 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.161773 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.161867 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.162110 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.162225 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.162458 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.162569 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.162771 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.162875 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.163076 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.163179 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.163392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.163504 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.163688 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.163801 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.163992 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.164095 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.164297 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.164399 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.164615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.164721 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.164958 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.165065 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.165195 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.165290 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.165497 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.165598 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.165800 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.165896 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.166104 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.166197 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.166430 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.166712 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.166825 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.167027 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.167135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.167334 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.167435 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.167639 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.167745 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.167944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.168051 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.168247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.168511 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.168619 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.168839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.168932 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.169153 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.169253 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.169479 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.169586 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.169792 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.169885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.170116 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.170208 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.170456 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.170572 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.170780 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.170881 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.171094 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.171196 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.171412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.171517 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.171718 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.171818 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.172022 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.172116 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.172334 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.172427 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.172652 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.172751 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.172961 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.173062 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.173264 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.173367 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.173566 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.173659 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.173874 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.173973 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.174177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.174270 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.174506 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.174649 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.174814 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.175081 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.175189 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.175277 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.175445 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.175771 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.176021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.176128 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.176342 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.176443 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.176651 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.176746 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.177152 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.177305 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.177305 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.178132 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.178285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.178467 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.178575 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.178776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.178870 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.179085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.179178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.179389 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.179501 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.179697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.179798 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.180002 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.180095 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.180306 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.180446 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.180609 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.180703 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.180934 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.181034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.181264 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.181371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.181578 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.181671 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.181909 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.182002 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.182226 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.182397 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.182574 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.182677 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.182889 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.182986 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.183213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.183318 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.183531 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.183710 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.183849 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.183987 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.184138 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129370) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 17:52:01.184280 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.184461 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.184774 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.185230 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.185382 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.185694 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.186003 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.186317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.186664 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.186993 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.187302 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.187629 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.187947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.188268 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.188582 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.188892 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.189221 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.189530 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.189840 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.190155 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.190487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.190799 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.191114 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.191427 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.191752 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.192081 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.192392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.192719 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.193047 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.193964 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.194279 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.194649 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.194979 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.195318 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.195610 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.195918 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 17:52:01.196161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129371) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 17:52:01.246545 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO dbcounter [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Registered counter for database nova_api Jun 30 17:52:01.258518 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO dbcounter [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Registered counter for database nova_api Jun 30 17:52:01.267157 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_db.sqlalchemy.engines [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:52:01.273797 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writer thread running {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:52:01.278653 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_db.sqlalchemy.engines [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:52:01.285163 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writer thread running {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:52:01.329718 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.context [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),971563eb-4a0b-4a3d-98cf-496d4678315e(cell1) {{(pid=129370) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 17:52:01.333866 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:52:01.335498 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:52:01.336299 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:52:01.338273 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:52:01.340277 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO dbcounter [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Registered counter for database nova_cell0 Jun 30 17:52:01.341314 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.context [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),971563eb-4a0b-4a3d-98cf-496d4678315e(cell1) {{(pid=129371) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 17:52:01.344318 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO dbcounter [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Registered counter for database nova_cell1 Jun 30 17:52:01.345410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:52:01.347040 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:52:01.347840 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:52:01.350432 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:52:01.352448 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO dbcounter [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Registered counter for database nova_cell0 Jun 30 17:52:01.353615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_db.sqlalchemy.engines [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:52:01.355834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_db.sqlalchemy.engines [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:52:01.356604 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO dbcounter [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Registered counter for database nova_cell1 Jun 30 17:52:01.360944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writer thread running {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:52:01.363696 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writer thread running {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:52:01.363852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_db.sqlalchemy.engines [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:52:01.366714 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_db.sqlalchemy.engines [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:52:01.372107 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writer thread running {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:52:01.374191 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writer thread running {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:52:01.510446 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO dbcounter [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Registered counter for database nova_cell0 Jun 30 17:52:01.516833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_db.sqlalchemy.engines [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129370) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:52:01.519959 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO dbcounter [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Registered counter for database nova_cell0 Jun 30 17:52:01.521217 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writer thread running {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:52:01.527809 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_db.sqlalchemy.engines [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129371) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 17:52:01.532222 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writer thread running {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 17:52:01.840550 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: WARNING keystonemiddleware.auth_token [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 17:52:01.847885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: WARNING keystonemiddleware.auth_token [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 17:52:01.848916 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: WARNING keystonemiddleware.auth_token [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 17:52:01.856396 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: WARNING keystonemiddleware.auth_token [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 17:52:02.202925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: WARNING keystonemiddleware.auth_token [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 17:52:02.204087 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: WARNING keystonemiddleware.auth_token [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 17:52:02.209078 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: WARNING keystonemiddleware.auth_token [None req-eddf9a72-17cf-4fca-9865-9c5279655428 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 17:52:02.210046 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: WARNING keystonemiddleware.auth_token [None req-9d9154fc-957d-4e3b-b9d7-09aa9904c0f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 17:52:02.214998 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557cdf2a09c0 pid: 129370 (default app) Jun 30 17:52:02.215392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557cdf2a09c0 pid: 129371 (default app) Jun 30 17:52:42.936469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=3 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:52:42.938968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=3 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:52:42.940084 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=3 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:52:42.941584 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=3 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:52:43.214179 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=3 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:52:43.215207 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=3 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:52:43.216853 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=3 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:52:43.217715 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=3 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:52:44.242439 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c59b22a6-3161-412c-957d-39a3739b9a19 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] Action: 'create', calling method: .version_select at 0x7f8f3d1d7430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-850430606", "metadata": {"Type": "work"}}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:52:44.347508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-bd912ca8-42f7-4341-9070-f645ac50e894 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Action: 'create', calling method: .version_select at 0x7f8f3d1d5430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1163908233"}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:52:45.669938 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c59b22a6-3161-412c-957d-39a3739b9a19 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.752875 Jun 30 17:52:45.671763 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jun 30 17:52:42 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2756 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 30 17:52:45.736410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-bd912ca8-42f7-4341-9070-f645ac50e894 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.535053 Jun 30 17:52:45.744901 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1154 bytes} [Thu Jun 30 17:52:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2539 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 30 17:52:45.746176 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-22dd6b5d-cebe-4a4e-a5c4-8df0f85777c5 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] Calling method '.version_select at 0x7f8f3d09e310>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:45.888681 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-22dd6b5d-cebe-4a4e-a5c4-8df0f85777c5 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c" status: 200 len: 352 microversion: 2.1 time: 0.144343 Jun 30 17:52:45.889712 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:52:45 2022] GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c => generated 352 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:45.901286 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3fe4adfa-31c6-4c45-8af8-faee9b7b3384 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d09e4c0>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:46.088210 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3fe4adfa-31c6-4c45-8af8-faee9b7b3384 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4" status: 200 len: 345 microversion: 2.1 time: 0.197057 Jun 30 17:52:46.089969 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:52:45 2022] GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 => generated 345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:46.362695 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9bd673ab-f769-4c11-93ec-723156f330c2 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Action: 'create', calling method: .version_select at 0x7f8f3d09e280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2086383627", "metadata": {"Type": "work"}}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9bd673ab-f769-4c11-93ec-723156f330c2 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Request method failure captured: Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 122 Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveLrd_lKmt67X8xmtzLpHUt8IcNYXuCroL4QlCH-LQUIqLbXNwpk7l1tvlNyiW_w40aNqteSfYdCHMBOIaYQhIkVwSUfBBXB4hx_qV2RJF82Fmalv7a5m2CsmDZFI2E-GD55Kr9SmZOkrr2MmEX0Vd6e6b3K2IuKCdBcrweE5FaOR2k Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:52:46.397923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28015334d69f46da8516a6297be2cec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28015334d69f46da8516a6297be2cec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}] Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 973b896d0e4e4bafb67f9508d141881c Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2086383627", "metadata": {"Type": "work"}}} Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: Jun 30 17:52:46.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2086383627', 'metadata': {'Type': 'work'}}}} Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise error Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi '#$%' Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:52:46.401247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 17:52:46.402913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 17:52:46.405376 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 17:52:46.405376 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.405376 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9bd673ab-f769-4c11-93ec-723156f330c2 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:52:46.405376 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-9bd673ab-f769-4c11-93ec-723156f330c2 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.726914 Jun 30 17:52:46.408217 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 2/5] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jun 30 17:52:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 735 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 17:52:46.415258 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4a034517-3298-42f4-9589-608389d5166e tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Action: 'create', calling method: .version_select at 0x7f8f3d09ea60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-788600748", "metadata": {"Type": "work"}}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4a034517-3298-42f4-9589-608389d5166e tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Request method failure captured: Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 119 Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveLrd_lKmt67X8xmtzLpHUt8IcNYXuCroL4QlCH-LQUIqLbXNwpk7l1tvlNyiW_w40aNqteSfYdCHMBOIaYQhIkVwSUfBBXB4hx_qV2RJF82Fmalv7a5m2CsmDZFI2E-GD55Kr9SmZOkrr2MmEX0Vd6e6b3K2IuKCdBcrweE5FaOR2k Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 17:52:46.430776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28015334d69f46da8516a6297be2cec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28015334d69f46da8516a6297be2cec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}] Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 973b896d0e4e4bafb67f9508d141881c Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-788600748", "metadata": {"Type": "work"}}} Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: Jun 30 17:52:46.432162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-788600748', 'metadata': {'Type': 'work'}}}} Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise error Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi '0' Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:52:46.432928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 17:52:46.434206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 17:52:46.435339 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 17:52:46.435339 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.435339 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4a034517-3298-42f4-9589-608389d5166e tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:52:46.438615 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4a034517-3298-42f4-9589-608389d5166e tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028099 Jun 30 17:52:46.439355 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 4/6] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jun 30 17:52:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 17:52:46.448242 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6ec3059f-ba72-4ec6-8dde-c6f276aa51ee tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Action: 'create', calling method: .version_select at 0x7f8f3d067280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-716882553", "metadata": {"Type": "work"}}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6ec3059f-ba72-4ec6-8dde-c6f276aa51ee tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Request method failure captured: Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 118 Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveLrd_lKmt67X8xmtzLpHUt8IcNYXuCroL4QlCH-LQUIqLbXNwpk7l1tvlNyiW_w40aNqteSfYdCHMBOIaYQhIkVwSUfBBXB4hx_qV2RJF82Fmalv7a5m2CsmDZFI2E-GD55Kr9SmZOkrr2MmEX0Vd6e6b3K2IuKCdBcrweE5FaOR2k Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:52:46.450861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28015334d69f46da8516a6297be2cec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28015334d69f46da8516a6297be2cec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}] Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 973b896d0e4e4bafb67f9508d141881c Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-716882553", "metadata": {"Type": "work"}}} Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: Jun 30 17:52:46.452148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-716882553', 'metadata': {'Type': 'work'}}}} Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise error Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi '' Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:52:46.452968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 17:52:46.455968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 17:52:46.457832 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 17:52:46.457832 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.457832 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6ec3059f-ba72-4ec6-8dde-c6f276aa51ee tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:52:46.457832 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6ec3059f-ba72-4ec6-8dde-c6f276aa51ee tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007753 Jun 30 17:52:46.457832 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 3/7] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Jun 30 17:52:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 30 17:52:46.477889 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-75d2f05e-6047-447c-8637-9e3b69346343 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Calling method '.version_select at 0x7f8f3da83700>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:46.550768 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-75d2f05e-6047-447c-8637-9e3b69346343 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] HTTP exception thrown: Volume tempest-invalid-936749285 could not be found. Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-75d2f05e-6047-447c-8637-9e3b69346343 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Request method failure captured: Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-936749285 HTTP/1.1 Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveLrd_lKmt67X8xmtzLpHUt8IcNYXuCroL4QlCH-LQUIqLbXNwpk7l1tvlNyiW_w40aNqteSfYdCHMBOIaYQhIkVwSUfBBXB4hx_qV2RJF82Fmalv7a5m2CsmDZFI2E-GD55Kr9SmZOkrr2MmEX0Vd6e6b3K2IuKCdBcrweE5FaOR2k Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 17:52:46.559911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28015334d69f46da8516a6297be2cec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28015334d69f46da8516a6297be2cec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}] Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 973b896d0e4e4bafb67f9508d141881c Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Volume tempest-invalid-936749285 could not be found. Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': 'tempest-invalid-936749285'} Jun 30 17:52:46.561616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-936749285 could not be found. (HTTP 404) (Request-ID: req-a5183afc-c190-49a6-affc-0dba676af37d) Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.562661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 17:52:46.564735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-936749285 could not be found. Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:52:46.566130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-936749285 could not be found. Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-936749285 could not be found. Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-75d2f05e-6047-447c-8637-9e3b69346343 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Returning 404 to user: Volume tempest-invalid-936749285 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-75d2f05e-6047-447c-8637-9e3b69346343 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-936749285" status: 404 len: 98 microversion: 2.1 time: 0.105748 Jun 30 17:52:46.571877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1214 bytes} [Thu Jun 30 17:52:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-936749285 => generated 98 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 30 17:52:46.583798 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-58f0a838-70e2-474c-a0ee-3a2734642f14 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007202 Jun 30 17:52:46.584543 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 4/9] 10.222.0.16 () {58 vars in 1139 bytes} [Thu Jun 30 17:52:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 30 17:52:46.596799 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-efbc7566-4865-44e9-b98e-fca78ef08ed1 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004304 Jun 30 17:52:46.597352 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1136 bytes} [Thu Jun 30 17:52:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 17:52:46.609562 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-685bf278-bc06-4ec0-afd0-a7376629d5e8 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Calling method '.version_select at 0x7f8f3d09ee50>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:46.659164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-685bf278-bc06-4ec0-afd0-a7376629d5e8 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] HTTP exception thrown: Volume 92617aa5-435b-4ff9-81e5-d5b9d0860ad6 could not be found. Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-685bf278-bc06-4ec0-afd0-a7376629d5e8 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Request method failure captured: Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: DELETE /compute/v2.1/os-volumes/92617aa5-435b-4ff9-81e5-d5b9d0860ad6 HTTP/1.1 Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveLrd_lKmt67X8xmtzLpHUt8IcNYXuCroL4QlCH-LQUIqLbXNwpk7l1tvlNyiW_w40aNqteSfYdCHMBOIaYQhIkVwSUfBBXB4hx_qV2RJF82Fmalv7a5m2CsmDZFI2E-GD55Kr9SmZOkrr2MmEX0Vd6e6b3K2IuKCdBcrweE5FaOR2k Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:52:46.663820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28015334d69f46da8516a6297be2cec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28015334d69f46da8516a6297be2cec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}] Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 973b896d0e4e4bafb67f9508d141881c Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Volume 92617aa5-435b-4ff9-81e5-d5b9d0860ad6 could not be found. Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '92617aa5-435b-4ff9-81e5-d5b9d0860ad6'} Jun 30 17:52:46.665411 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92617aa5-435b-4ff9-81e5-d5b9d0860ad6 could not be found. (HTTP 404) (Request-ID: req-77c44980-4b64-4089-a6ca-6d31b390040b) Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.666418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 17:52:46.667879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92617aa5-435b-4ff9-81e5-d5b9d0860ad6 could not be found. Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 17:52:46.669191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92617aa5-435b-4ff9-81e5-d5b9d0860ad6 could not be found. Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92617aa5-435b-4ff9-81e5-d5b9d0860ad6 could not be found. Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.679073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-685bf278-bc06-4ec0-afd0-a7376629d5e8 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Returning 404 to user: Volume 92617aa5-435b-4ff9-81e5-d5b9d0860ad6 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:52:46.681127 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-685bf278-bc06-4ec0-afd0-a7376629d5e8 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/92617aa5-435b-4ff9-81e5-d5b9d0860ad6" status: 404 len: 109 microversion: 2.1 time: 0.076766 Jun 30 17:52:46.682753 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 5/11] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 17:52:46 2022] DELETE /compute/v2.1/os-volumes/92617aa5-435b-4ff9-81e5-d5b9d0860ad6 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:52:46.691735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-40779415-b615-475c-979c-81b66f8146d0 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Calling method '.version_select at 0x7f8f3d0388b0>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:46.757446 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-40779415-b615-475c-979c-81b66f8146d0 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] HTTP exception thrown: Volume 9e1c5e86-9750-4703-8be0-8c28a4a5beb5 could not be found. Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-40779415-b615-475c-979c-81b66f8146d0 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Request method failure captured: Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/os-volumes/9e1c5e86-9750-4703-8be0-8c28a4a5beb5 HTTP/1.1 Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveLrd_lKmt67X8xmtzLpHUt8IcNYXuCroL4QlCH-LQUIqLbXNwpk7l1tvlNyiW_w40aNqteSfYdCHMBOIaYQhIkVwSUfBBXB4hx_qV2RJF82Fmalv7a5m2CsmDZFI2E-GD55Kr9SmZOkrr2MmEX0Vd6e6b3K2IuKCdBcrweE5FaOR2k Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 17:52:46.759420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28015334d69f46da8516a6297be2cec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28015334d69f46da8516a6297be2cec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28015334d69f46da8516a6297be2cec3"}]}] Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 28015334d69f46da8516a6297be2cec3 Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-VolumesNegativeTest-345090531 Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 973b896d0e4e4bafb67f9508d141881c Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-VolumesNegativeTest-345090531-project Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Volume 9e1c5e86-9750-4703-8be0-8c28a4a5beb5 could not be found. Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '9e1c5e86-9750-4703-8be0-8c28a4a5beb5'} Jun 30 17:52:46.760827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e1c5e86-9750-4703-8be0-8c28a4a5beb5 could not be found. (HTTP 404) (Request-ID: req-2c4308a5-40af-4d9b-9637-3336dd44c312) Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.761732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:52:46.763063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e1c5e86-9750-4703-8be0-8c28a4a5beb5 could not be found. Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 17:52:46.765016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e1c5e86-9750-4703-8be0-8c28a4a5beb5 could not be found. Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e1c5e86-9750-4703-8be0-8c28a4a5beb5 could not be found. Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-40779415-b615-475c-979c-81b66f8146d0 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] Returning 404 to user: Volume 9e1c5e86-9750-4703-8be0-8c28a4a5beb5 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-40779415-b615-475c-979c-81b66f8146d0 tempest-VolumesNegativeTest-345090531 tempest-VolumesNegativeTest-345090531-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9e1c5e86-9750-4703-8be0-8c28a4a5beb5" status: 404 len: 109 microversion: 2.1 time: 0.074123 Jun 30 17:52:46.767013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:52:46 2022] GET /compute/v2.1/os-volumes/9e1c5e86-9750-4703-8be0-8c28a4a5beb5 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:52:46.909187 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-428ef6d3-e5e9-45fd-8788-857d643c394e tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] Calling method '.version_select at 0x7f8f3d042040>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:47.074530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-428ef6d3-e5e9-45fd-8788-857d643c394e tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c" status: 200 len: 353 microversion: 2.1 time: 0.170133 Jun 30 17:52:47.075318 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:52:46 2022] GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:47.101768 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ae3a0edb-e384-4232-9935-1227bc82aa7c tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] Calling method '.version_select at 0x7f8f3d0abaf0>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:47.111523 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-468affb5-b7ef-4ea7-8a3c-5e53b3e71f8b tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d067940>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:47.274417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-468affb5-b7ef-4ea7-8a3c-5e53b3e71f8b tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4" status: 200 len: 345 microversion: 2.1 time: 0.176970 Jun 30 17:52:47.281606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 7/14] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:52:47 2022] GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 => generated 345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:47.294509 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ae3a0edb-e384-4232-9935-1227bc82aa7c tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c" status: 200 len: 353 microversion: 2.1 time: 0.210272 Jun 30 17:52:47.296050 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:52:47 2022] GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:47.310014 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d3815e9c-76b8-4d4e-bc7f-1b1a4e9d2b30 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] Calling method '.version_select at 0x7f8f3d067ee0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:47.422528 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d3815e9c-76b8-4d4e-bc7f-1b1a4e9d2b30 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c" status: 202 len: 0 microversion: 2.1 time: 0.117669 Jun 30 17:52:47.424424 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 17:52:47 2022] DELETE /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 17:52:47.433419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b9d57030-bb64-4f7f-be52-7a951b787cff tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] Calling method '.version_select at 0x7f8f3d038a60>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:47.517332 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b9d57030-bb64-4f7f-be52-7a951b787cff tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c" status: 200 len: 352 microversion: 2.1 time: 0.088257 Jun 30 17:52:47.518238 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 9/17] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:52:47 2022] GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c => generated 352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:48.290595 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4aeb24b5-1eee-48ee-8f91-851c2c9be8b1 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d09edc0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:48.356770 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4aeb24b5-1eee-48ee-8f91-851c2c9be8b1 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4" status: 200 len: 346 microversion: 2.1 time: 0.071644 Jun 30 17:52:48.358469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 9/18] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:52:48 2022] GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:48.369234 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-cc37d064-db8d-47d0-862d-98d7e9b54573 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Action: 'create', calling method: .version_select at 0x7f8f3d09eaf0>, body: {"snapshot": {"volume_id": "01bab1d4-6743-44f5-b901-6c3a51b1e1c4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1796738811"}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:52:48.530036 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8ea3ad6c-0517-43d7-87b1-5342f42fa588 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] Calling method '.version_select at 0x7f8f3d09e550>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:48.580434 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-8ea3ad6c-0517-43d7-87b1-5342f42fa588 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] HTTP exception thrown: Volume 24baebbd-a645-4a4a-9a8e-4b9586b6458c could not be found. Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8ea3ad6c-0517-43d7-87b1-5342f42fa588 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] Request method failure captured: Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c HTTP/1.1 Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveLqw5pPmalMlWVKGPNB7cjeOyR2DqAp9pgvev69WGgkYrR7ozJRKeu1dVHaFJ56ji_aO3EbJ9BENgZFleJcsPL8wYXzYyn-DiHwnLWqlEvksSipFE2bHynTzqENqIs9JEW8PLpPe5WQ0d8XHNZT3UMQBxuWHR2TU7SEEn64UW8lz9Q Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 7c891a43f34e484fa45c50ad9ed5db84 Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-VolumesGetTestJSON-1172546089 Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:52:48.584244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7c891a43f34e484fa45c50ad9ed5db84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7c891a43f34e484fa45c50ad9ed5db84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c891a43f34e484fa45c50ad9ed5db84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7c891a43f34e484fa45c50ad9ed5db84"}]}] Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-VolumesGetTestJSON-1172546089 Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 7c891a43f34e484fa45c50ad9ed5db84 Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-VolumesGetTestJSON-1172546089 Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-VolumesGetTestJSON-1172546089-project Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 559bfe19414945eab1e907cf8f917b34 Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-VolumesGetTestJSON-1172546089-project Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Volume 24baebbd-a645-4a4a-9a8e-4b9586b6458c could not be found. Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '24baebbd-a645-4a4a-9a8e-4b9586b6458c'} Jun 30 17:52:48.585540 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24baebbd-a645-4a4a-9a8e-4b9586b6458c could not be found. (HTTP 404) (Request-ID: req-806a24bb-135a-4897-91b4-aa98e2df6a05) Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:48.586296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:52:48.587390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24baebbd-a645-4a4a-9a8e-4b9586b6458c could not be found. Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 17:52:48.588359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24baebbd-a645-4a4a-9a8e-4b9586b6458c could not be found. Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24baebbd-a645-4a4a-9a8e-4b9586b6458c could not be found. Jun 30 17:52:48.589431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:52:48.590880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8ea3ad6c-0517-43d7-87b1-5342f42fa588 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] Returning 404 to user: Volume 24baebbd-a645-4a4a-9a8e-4b9586b6458c could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:52:48.592490 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8ea3ad6c-0517-43d7-87b1-5342f42fa588 tempest-VolumesGetTestJSON-1172546089 tempest-VolumesGetTestJSON-1172546089-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c" status: 404 len: 109 microversion: 2.1 time: 0.066644 Jun 30 17:52:48.593586 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 10/19] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:52:48 2022] GET /compute/v2.1/os-volumes/24baebbd-a645-4a4a-9a8e-4b9586b6458c => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:52:49.057347 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-cc37d064-db8d-47d0-862d-98d7e9b54573 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.691838 Jun 30 17:52:49.058099 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1161 bytes} [Thu Jun 30 17:52:48 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:49.068179 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-89781c72-f0e4-4077-af70-1f733a7013e4 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d09edc0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:49.244449 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-89781c72-f0e4-4077-af70-1f733a7013e4 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.180105 Jun 30 17:52:49.244945 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:49 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:49.257435 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-490f7903-81a3-4598-a84b-659e55cf3fca tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d038c10>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:49.392735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-490f7903-81a3-4598-a84b-659e55cf3fca tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.140459 Jun 30 17:52:49.393576 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 11/22] 10.222.0.16 () {58 vars in 1139 bytes} [Thu Jun 30 17:52:49 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:49.404120 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-be40a3ef-2b9d-48dc-86d9-f189561db7d7 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d067310>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:49.494808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-be40a3ef-2b9d-48dc-86d9-f189561db7d7 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.094423 Jun 30 17:52:49.495375 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:49 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:50.507687 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-caaff484-6897-4399-826b-7d133a9d7d66 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d03f0d0>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:50.580422 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-caaff484-6897-4399-826b-7d133a9d7d66 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.077618 Jun 30 17:52:50.584432 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:50 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:51.593662 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-f07661c6-b774-4af5-8028-1c8e1d1126b5 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d09e700>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:51.664409 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-f07661c6-b774-4af5-8028-1c8e1d1126b5 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.075727 Jun 30 17:52:51.664986 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:51 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:52.677162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-f17ab36f-2489-48b7-a700-811ce772aa0e tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d038430>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:52.734084 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-f17ab36f-2489-48b7-a700-811ce772aa0e tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.061440 Jun 30 17:52:52.737324 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:52 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:53.748136 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1857b9a6-968c-4097-8b6e-4fe58db7d70d tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d1d7ee0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:53.817096 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1857b9a6-968c-4097-8b6e-4fe58db7d70d tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.072883 Jun 30 17:52:53.818593 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:53 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:54.829566 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-22ce3e50-8ad5-4cdc-a529-3695ac092ed6 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d038af0>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:54.887804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-22ce3e50-8ad5-4cdc-a529-3695ac092ed6 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.062278 Jun 30 17:52:54.888720 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:54 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:55.899832 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-16495301-f7d3-477b-9e9c-3a81bded0c7a tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d067a60>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:55.952839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-16495301-f7d3-477b-9e9c-3a81bded0c7a tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 288 microversion: 2.1 time: 0.056904 Jun 30 17:52:55.954240 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:55 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:55.965760 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-084c2a84-ab75-4bfe-85ee-b56a0ab865a5 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d0abee0>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:56.126216 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-084c2a84-ab75-4bfe-85ee-b56a0ab865a5 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 202 len: 0 microversion: 2.1 time: 0.165691 Jun 30 17:52:56.127302 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 15/30] 10.222.0.16 () {58 vars in 1253 bytes} [Thu Jun 30 17:52:55 2022] DELETE /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 17:52:56.138952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-36c47393-0c2d-473b-b71f-68865c242438 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d018af0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:56.199901 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-36c47393-0c2d-473b-b71f-68865c242438 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.067940 Jun 30 17:52:56.200928 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 16/31] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:56 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:56.773262 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0bf0a43c-be75-4994-8162-be23f1224180 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Action: 'create', calling method: .version_select at 0x7f8f3d09eb80>, body: {"keypair": {"name": "tempest-keypair-1183579316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd4wtjb9AIOzPsD9gxqzNiOyRSNTq79i/oserOIHO6YNMBbZvsvKp08TlgrHCxvk83RHsUx8T7o/8QgpfKcHNwTRT6usMjqVi7QUe8gmGtHJo8M+41shUCVkfm1nrDg0w=="}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:52:56.895442 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-0bf0a43c-be75-4994-8162-be23f1224180 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Getting quotas for project 2ed15171dff7466fab5d482c7fbb7b10. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:52:56.915416 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-0bf0a43c-be75-4994-8162-be23f1224180 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Getting quotas for user 63422b2e34eb479f972a181fb37f3608 and project 2ed15171dff7466fab5d482c7fbb7b10. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:52:57.039578 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0bf0a43c-be75-4994-8162-be23f1224180 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.583106 Jun 30 17:52:57.040277 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 16/32] 10.222.0.16 () {62 vars in 1199 bytes} [Thu Jun 30 17:52:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 585 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 17:52:57.212794 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5395b1d0-e508-4cca-8452-3da89cf307cf tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d018b80>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:57.293557 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5395b1d0-e508-4cca-8452-3da89cf307cf tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.083861 Jun 30 17:52:57.296691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 17/33] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:57 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:58.310224 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-fb51c865-cb8a-4516-b4e4-439f01e05b75 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d067dc0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:58.403150 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-794451195", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "networks": [{"uuid": "d736fc18-f4ac-4b75-8fc4-7408729a6aee"}]}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:52:58.404336 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-fb51c865-cb8a-4516-b4e4-439f01e05b75 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.102311 Jun 30 17:52:58.408433 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 18/34] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:58 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:58.630574 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] validate_networks() for [('d736fc18-f4ac-4b75-8fc4-7408729a6aee', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 17:52:58.952890 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c669cf61-3693-4853-86f4-f7596adda99e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Action: 'create', calling method: .version_select at 0x7f8f3d09ea60>, body: {"keypair": {"name": "tempest-keypair-1029274118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIgSNxgxWexHXm9K96aQsyr/+izBhWmqq0nDRSi9YlS9R83mL20eiwgBi1PkfTTT2pBcOdYT7Nke6NZ9+sHnH5/FsA17XmRqAoAemP0eb4U3/L9pNDofE9V1PVeR8Lckw=="}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:52:59.089563 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-c669cf61-3693-4853-86f4-f7596adda99e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:52:59.101507 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-c669cf61-3693-4853-86f4-f7596adda99e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for user 2ed5e98a29c44296aeb921af4f521042 and project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:52:59.174461 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c669cf61-3693-4853-86f4-f7596adda99e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.503708 Jun 30 17:52:59.176932 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 19/35] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 17:52:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:52:59.419147 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9bad0f0e-c15f-40c9-bcb4-67f3afe1b692 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3cf85e50>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:52:59.525776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-9bad0f0e-c15f-40c9-bcb4-67f3afe1b692 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 200 len: 287 microversion: 2.1 time: 0.112886 Jun 30 17:52:59.526393 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 20/36] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:52:59 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:53:00.540388 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a6e6088f-ac0b-4f17-9946-a729238a52d3 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3cfbf550>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:00.641486 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-a6e6088f-ac0b-4f17-9946-a729238a52d3 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] HTTP exception thrown: Snapshot 5c751eb4-d237-4b21-a0f5-c8be4afe77e7 could not be found. Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a6e6088f-ac0b-4f17-9946-a729238a52d3 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Request method failure captured: Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 HTTP/1.1 Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveLraezbWcTpDNK4kE1vlzZQzEXg9Q-xJtm0a6tX6H578m5AYCJbFKCz2dXsThx4yduQkUr340TjzstyrcfXkGwetWyLUKFjqf_BgmGbGcpdoWhJAnMa2Yhjw-gBO84WvKKendLqvtgvV_X17KWx0zV3r8IhrM7q2RhhGco54amvA9M Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 73169e09f9ea4f92aec0a87cb01625b3 Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:53:00.643880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73169e09f9ea4f92aec0a87cb01625b3"}]}] Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 73169e09f9ea4f92aec0a87cb01625b3 Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-VolumesSnapshotsTestJSON-794991201-project Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: f8f558b28f094cb8b833666b44a242f5 Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-VolumesSnapshotsTestJSON-794991201-project Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Snapshot 5c751eb4-d237-4b21-a0f5-c8be4afe77e7 could not be found. Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '5c751eb4-d237-4b21-a0f5-c8be4afe77e7'} Jun 30 17:53:00.645776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5c751eb4-d237-4b21-a0f5-c8be4afe77e7 could not be found. (HTTP 404) (Request-ID: req-30309332-6c04-4c1c-a806-0ad19cc022ad) Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:00.646666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:53:00.647813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5c751eb4-d237-4b21-a0f5-c8be4afe77e7 could not be found. Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 30 17:53:00.648850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5c751eb4-d237-4b21-a0f5-c8be4afe77e7 could not be found. Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5c751eb4-d237-4b21-a0f5-c8be4afe77e7 could not be found. Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a6e6088f-ac0b-4f17-9946-a729238a52d3 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Returning 404 to user: Snapshot 5c751eb4-d237-4b21-a0f5-c8be4afe77e7 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a6e6088f-ac0b-4f17-9946-a729238a52d3 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7" status: 404 len: 111 microversion: 2.1 time: 0.110601 Jun 30 17:53:00.649961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 21/37] 10.222.0.16 () {58 vars in 1250 bytes} [Thu Jun 30 17:53:00 2022] GET /compute/v2.1/os-snapshots/5c751eb4-d237-4b21-a0f5-c8be4afe77e7 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 17:53:00.660022 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e6f529a5-b895-46c8-a598-e8a4448d144e tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3d018ee0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:00.858877 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e6f529a5-b895-46c8-a598-e8a4448d144e tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4" status: 202 len: 0 microversion: 2.1 time: 0.206851 Jun 30 17:53:00.859709 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 22/38] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 17:53:00 2022] DELETE /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 17:53:00.865402 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-809a0a34-91c9-42b2-9755-f111dc7d4cdc tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3cfbf310>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:01.017184 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-809a0a34-91c9-42b2-9755-f111dc7d4cdc tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a7a95fed-21e6-4606-b555-55b6f09ddc2e" status: 200 len: 349 microversion: 2.1 time: 0.156410 Jun 30 17:53:01.025748 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 23/39] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:53:00 2022] GET /compute/v2.1/os-volumes/a7a95fed-21e6-4606-b555-55b6f09ddc2e => generated 349 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:01.030906 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-364912c7-a259-4dcd-9a21-5bf1550e0722 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3cf85550>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:01.146360 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-364912c7-a259-4dcd-9a21-5bf1550e0722 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4" status: 200 len: 345 microversion: 2.1 time: 0.119473 Jun 30 17:53:01.151975 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 24/40] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:53:01 2022] GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 => generated 345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:02.101127 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 17:53:02.103077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 17:53:02.103278 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 17:53:02.103791 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 17:53:02.104522 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 17:53:02.139072 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:02.141673 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:02.143268 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:02.144947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:02.160569 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e885bccd-511b-4f45-bd45-8f15aaaef75d tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3c755310>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:02.217896 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Getting quotas for project 66e3ea2346c743ef96f525d34c031848. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:53:02.231809 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Getting quotas for user 52a3c04395c64202b10451c270bac9c5 and project 66e3ea2346c743ef96f525d34c031848. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:53:02.285526 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 17:53:02.302785 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 17:53:02.471458 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-e885bccd-511b-4f45-bd45-8f15aaaef75d tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] HTTP exception thrown: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e885bccd-511b-4f45-bd45-8f15aaaef75d tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Request method failure captured: Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 HTTP/1.1 Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveLraezbWcTpDNK4kE1vlzZQzEXg9Q-xJtm0a6tX6H578m5AYCJbFKCz2dXsThx4yduQkUr340TjzstyrcfXkGwetWyLUKFjqf_BgmGbGcpdoWhJAnMa2Yhjw-gBO84WvKKendLqvtgvV_X17KWx0zV3r8IhrM7q2RhhGco54amvA9M Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 73169e09f9ea4f92aec0a87cb01625b3 Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:53:02.473437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73169e09f9ea4f92aec0a87cb01625b3"}]}] Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 73169e09f9ea4f92aec0a87cb01625b3 Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-VolumesSnapshotsTestJSON-794991201-project Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: f8f558b28f094cb8b833666b44a242f5 Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-VolumesSnapshotsTestJSON-794991201-project Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '01bab1d4-6743-44f5-b901-6c3a51b1e1c4'} Jun 30 17:53:02.474636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. (HTTP 404) (Request-ID: req-a80a78b2-ea26-45ae-90e7-efccfc0f9ecc) Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:02.475534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:53:02.476633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 17:53:02.477955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e885bccd-511b-4f45-bd45-8f15aaaef75d tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Returning 404 to user: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e885bccd-511b-4f45-bd45-8f15aaaef75d tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4" status: 404 len: 109 microversion: 2.1 time: 0.319869 Jun 30 17:53:02.482064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 25/41] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:53:02 2022] GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 => generated 109 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:53:02.492217 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a4896ce2-1a2b-4680-a889-6877c77ac64a tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3cfbf040>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:02.522785 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-802e7a85-2a8b-4f02-9273-4bd725db8d79 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.386909 Jun 30 17:53:02.536329 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 17/42] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 17:52:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 17:53:02.549477 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4329bc28-5812-4646-a258-9d40afa20aaa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:02.551012 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4329bc28-5812-4646-a258-9d40afa20aaa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:02.727802 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-a4896ce2-1a2b-4680-a889-6877c77ac64a tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] HTTP exception thrown: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a4896ce2-1a2b-4680-a889-6877c77ac64a tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Request method failure captured: Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: DELETE /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 HTTP/1.1 Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveLraezbWcTpDNK4kE1vlzZQzEXg9Q-xJtm0a6tX6H578m5AYCJbFKCz2dXsThx4yduQkUr340TjzstyrcfXkGwetWyLUKFjqf_BgmGbGcpdoWhJAnMa2Yhjw-gBO84WvKKendLqvtgvV_X17KWx0zV3r8IhrM7q2RhhGco54amvA9M Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 73169e09f9ea4f92aec0a87cb01625b3 Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:53:02.730643 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73169e09f9ea4f92aec0a87cb01625b3"}]}] Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 73169e09f9ea4f92aec0a87cb01625b3 Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-VolumesSnapshotsTestJSON-794991201-project Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: f8f558b28f094cb8b833666b44a242f5 Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-VolumesSnapshotsTestJSON-794991201-project Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '01bab1d4-6743-44f5-b901-6c3a51b1e1c4'} Jun 30 17:53:02.731893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. (HTTP 404) (Request-ID: req-dcb39bad-d46a-4e74-a3ff-c7ac40a89fc5) Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:02.732691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 17:53:02.734091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 17:53:02.735292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a4896ce2-1a2b-4680-a889-6877c77ac64a tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Returning 404 to user: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a4896ce2-1a2b-4680-a889-6877c77ac64a tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4" status: 404 len: 109 microversion: 2.1 time: 0.246448 Jun 30 17:53:02.736392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 26/43] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 17:53:02 2022] DELETE /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 => generated 109 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:53:02.744755 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-715ea606-bacd-4414-9ebc-4550734647b1 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Calling method '.version_select at 0x7f8f3da83670>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:02.992826 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-715ea606-bacd-4414-9ebc-4550734647b1 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] HTTP exception thrown: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-715ea606-bacd-4414-9ebc-4550734647b1 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Request method failure captured: Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 HTTP/1.1 Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveLraezbWcTpDNK4kE1vlzZQzEXg9Q-xJtm0a6tX6H578m5AYCJbFKCz2dXsThx4yduQkUr340TjzstyrcfXkGwetWyLUKFjqf_BgmGbGcpdoWhJAnMa2Yhjw-gBO84WvKKendLqvtgvV_X17KWx0zV3r8IhrM7q2RhhGco54amvA9M Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 73169e09f9ea4f92aec0a87cb01625b3 Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:53:02.994974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73169e09f9ea4f92aec0a87cb01625b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/73169e09f9ea4f92aec0a87cb01625b3"}]}] Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 73169e09f9ea4f92aec0a87cb01625b3 Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-794991201 Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-VolumesSnapshotsTestJSON-794991201-project Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: f8f558b28f094cb8b833666b44a242f5 Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-VolumesSnapshotsTestJSON-794991201-project Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '01bab1d4-6743-44f5-b901-6c3a51b1e1c4'} Jun 30 17:53:02.996038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. (HTTP 404) (Request-ID: req-f3478e5b-77c5-4fbb-b901-94fafe5f7405) Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:02.996725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 17:53:02.997679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 17:53:02.998615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-715ea606-bacd-4414-9ebc-4550734647b1 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] Returning 404 to user: Volume 01bab1d4-6743-44f5-b901-6c3a51b1e1c4 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-715ea606-bacd-4414-9ebc-4550734647b1 tempest-VolumesSnapshotsTestJSON-794991201 tempest-VolumesSnapshotsTestJSON-794991201-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4" status: 404 len: 109 microversion: 2.1 time: 0.259288 Jun 30 17:53:02.999539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 27/44] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:53:02 2022] GET /compute/v2.1/os-volumes/01bab1d4-6743-44f5-b901-6c3a51b1e1c4 => generated 109 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:53:03.017432 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-94b30369-54fd-49e2-886c-2e9bb419afbe tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3cf85820>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:03.271339 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-94b30369-54fd-49e2-886c-2e9bb419afbe tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9a5fef51-b876-4bda-93d0-f7bea9766b11" status: 200 len: 350 microversion: 2.1 time: 0.258208 Jun 30 17:53:03.281908 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 28/45] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:53:03 2022] GET /compute/v2.1/os-volumes/9a5fef51-b876-4bda-93d0-f7bea9766b11 => generated 350 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:03.512998 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4329bc28-5812-4646-a258-9d40afa20aaa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:03.539465 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4329bc28-5812-4646-a258-9d40afa20aaa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1214 microversion: 2.1 time: 1.006798 Jun 30 17:53:03.552578 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 18/46] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:02 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1214 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:03.632390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-344809990", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "deee4646-f06a-4861-a34a-8d7afdbfbf09"}], "security_groups": [{"name": "tempest-securitygroup--551060597"}], "key_name": "tempest-keypair-1029274118", "user_data": "}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:04.007454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.network.neutron [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] validate_networks() for [('deee4646-f06a-4861-a34a-8d7afdbfbf09', None, None, None, None, None)] {{(pid=129370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 17:53:04.095001 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-982234484", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9615341-92d6-4123-83a6-4a508b4a2c42"}], "security_groups": [{"name": "tempest-securitygroup--1330442498"}], "key_name": "tempest-keypair-1183579316", "user_data": "}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:04.538315 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] validate_networks() for [('b9615341-92d6-4123-83a6-4a508b4a2c42', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 17:53:05.953945 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Flavor limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 17:53:05.954753 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Image limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 17:53:05.955288 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Flavor pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 17:53:05.957148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Image pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 17:53:05.957575 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 17:53:05.970894 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:05.971668 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:05.973474 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:05.974127 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:06.007789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:53:06.014788 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for user 2ed5e98a29c44296aeb921af4f521042 and project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:53:06.031161 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Going to run 1 instances... {{(pid=129370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 17:53:06.034151 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 17:53:06.052611 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 17:53:06.053551 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 17:53:06.054187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 17:53:06.054937 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 17:53:06.055616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 17:53:06.081635 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:06.086306 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:06.087950 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:06.089368 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:06.146320 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Getting quotas for project 2ed15171dff7466fab5d482c7fbb7b10. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:53:06.154552 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Getting quotas for user 63422b2e34eb479f972a181fb37f3608 and project 2ed15171dff7466fab5d482c7fbb7b10. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:53:06.184443 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 17:53:06.187194 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 17:53:06.221087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3da9e310-1c17-4684-878d-c92531c75ac7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.605403 Jun 30 17:53:06.226356 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 29/47] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 17:53:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 17:53:06.250307 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-99bd2719-15ff-4095-a4b9-f71afa271c08 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:06.251362 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-99bd2719-15ff-4095-a4b9-f71afa271c08 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:06.281309 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-99bd2719-15ff-4095-a4b9-f71afa271c08 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:06.281747 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-99bd2719-15ff-4095-a4b9-f71afa271c08 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:06.282812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-99bd2719-15ff-4095-a4b9-f71afa271c08 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:06.283383 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-99bd2719-15ff-4095-a4b9-f71afa271c08 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:06.320263 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-31537639-a845-4c41-8810-1be36aa28ebe tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.238934 Jun 30 17:53:06.323107 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 19/48] 10.222.0.16 () {62 vars in 1187 bytes} [Thu Jun 30 17:53:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 17:53:06.373929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-f430aab6-71d9-4126-9829-f0127c856e72 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3c690c10>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:06.509785 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-f430aab6-71d9-4126-9829-f0127c856e72 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/59cc6dd0-daee-4540-b156-599169304740" status: 200 len: 351 microversion: 2.1 time: 0.184932 Jun 30 17:53:06.510414 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 20/49] 10.222.0.16 () {58 vars in 1244 bytes} [Thu Jun 30 17:53:06 2022] GET /compute/v2.1/os-volumes/59cc6dd0-daee-4540-b156-599169304740 => generated 351 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:06.522371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-04a6c5ba-439c-446a-b7ed-b5aaf346af4d tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:06.523414 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-04a6c5ba-439c-446a-b7ed-b5aaf346af4d tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:06.763044 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-99bd2719-15ff-4095-a4b9-f71afa271c08 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:06.825086 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-99bd2719-15ff-4095-a4b9-f71afa271c08 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1274 microversion: 2.1 time: 0.595468 Jun 30 17:53:06.842277 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 30/50] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:06 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1274 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:06.862794 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-39460054-5362-4849-889f-c3c5ec8fc71e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:06.872106 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-39460054-5362-4849-889f-c3c5ec8fc71e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:06.879180 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-04a6c5ba-439c-446a-b7ed-b5aaf346af4d tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:06.899353 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-04a6c5ba-439c-446a-b7ed-b5aaf346af4d tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1241 microversion: 2.1 time: 0.377846 Jun 30 17:53:06.915376 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 21/51] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:06 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1241 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:06.940319 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7410f7df-8561-4452-a757-e8ec1498531d tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3c698f70>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:07.100941 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-39460054-5362-4849-889f-c3c5ec8fc71e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:07.155536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-39460054-5362-4849-889f-c3c5ec8fc71e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:07.160865 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-39460054-5362-4849-889f-c3c5ec8fc71e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:07.165519 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-39460054-5362-4849-889f-c3c5ec8fc71e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1281 microversion: 2.20 time: 0.320670 Jun 30 17:53:07.169688 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 31/52] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:06 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:07.375197 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7410f7df-8561-4452-a757-e8ec1498531d tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.456808 Jun 30 17:53:07.384586 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 22/53] 10.222.0.16 () {58 vars in 1133 bytes} [Thu Jun 30 17:53:06 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:07.389185 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7b11020a-c367-4e99-b423-9aaffe78701c tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3c640ca0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:07.639053 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-7b11020a-c367-4e99-b423-9aaffe78701c tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.253849 Jun 30 17:53:07.639640 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 32/54] 10.222.0.16 () {58 vars in 1148 bytes} [Thu Jun 30 17:53:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:07.655945 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-bdee6f31-90b8-4c91-b120-20dcf1367928 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3c6efb80>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:07.861099 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-90faa4d5-2cd4-47f3-ab58-1e269a3dfc62 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:07.861985 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-90faa4d5-2cd4-47f3-ab58-1e269a3dfc62 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:07.880610 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90faa4d5-2cd4-47f3-ab58-1e269a3dfc62 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:07.883947 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90faa4d5-2cd4-47f3-ab58-1e269a3dfc62 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:07.884764 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90faa4d5-2cd4-47f3-ab58-1e269a3dfc62 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:07.885207 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90faa4d5-2cd4-47f3-ab58-1e269a3dfc62 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:07.908238 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-bdee6f31-90b8-4c91-b120-20dcf1367928 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.259812 Jun 30 17:53:07.909076 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 23/55] 10.222.0.16 () {58 vars in 1133 bytes} [Thu Jun 30 17:53:07 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:07.920835 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a118ad15-7a74-4884-a877-e25f6aec7bfb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:07.921591 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a118ad15-7a74-4884-a877-e25f6aec7bfb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:08.090912 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-90faa4d5-2cd4-47f3-ab58-1e269a3dfc62 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:08.101424 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-90faa4d5-2cd4-47f3-ab58-1e269a3dfc62 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1272 microversion: 2.1 time: 0.246034 Jun 30 17:53:08.113671 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 33/56] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:07 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:08.123788 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a118ad15-7a74-4884-a877-e25f6aec7bfb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:08.159605 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a118ad15-7a74-4884-a877-e25f6aec7bfb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1241 microversion: 2.1 time: 0.241437 Jun 30 17:53:08.162619 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 24/57] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:07 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1241 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:08.175886 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6ec85731-a776-481b-9f1c-d4d381010660 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3c640ca0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:08.201589 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:08.202615 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:08.217510 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:08.218272 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:08.219300 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:08.219958 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:08.455488 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6ec85731-a776-481b-9f1c-d4d381010660 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.338528 Jun 30 17:53:08.457130 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 34/58] 10.222.0.16 () {58 vars in 1166 bytes} [Thu Jun 30 17:53:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:08.470317 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-cd3f8fd5-ef27-4daf-bf6b-2cf97d0d3281 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3c5d2820>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:08.582818 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:08.669719 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:08.678323 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:08.697639 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-20447915-df01-4428-b2d7-84781628f357 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1333 microversion: 2.20 time: 0.498358 Jun 30 17:53:08.698912 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 25/59] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:08 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1333 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:08.746621 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-cd3f8fd5-ef27-4daf-bf6b-2cf97d0d3281 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.280434 Jun 30 17:53:08.747192 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 35/60] 10.222.0.16 () {58 vars in 1169 bytes} [Thu Jun 30 17:53:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:08.765177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6bfcb306-6c93-4bf6-bc7a-45aa043acfef tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3c60d4c0>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:08.882312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6bfcb306-6c93-4bf6-bc7a-45aa043acfef tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.120537 Jun 30 17:53:08.882957 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 26/61] 10.222.0.16 () {58 vars in 1154 bytes} [Thu Jun 30 17:53:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:08.895608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-353ef462-9879-436d-8a17-d261dc4cc437 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3c5e4550>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:09.019009 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-353ef462-9879-436d-8a17-d261dc4cc437 tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.128138 Jun 30 17:53:09.027715 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 36/62] 10.222.0.16 () {58 vars in 1187 bytes} [Thu Jun 30 17:53:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:09.034030 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-31b7f92d-3896-44a6-9e1d-a4248ce9af9c tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] Calling method '.version_select at 0x7f8f3c5cd5e0>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:09.119952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c3f923bc-3af5-4702-8d73-737d2300d4d8 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:09.120706 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c3f923bc-3af5-4702-8d73-737d2300d4d8 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:09.127000 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c3f923bc-3af5-4702-8d73-737d2300d4d8 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:09.127539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c3f923bc-3af5-4702-8d73-737d2300d4d8 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:09.128548 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c3f923bc-3af5-4702-8d73-737d2300d4d8 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:09.129055 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c3f923bc-3af5-4702-8d73-737d2300d4d8 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:09.153820 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-31b7f92d-3896-44a6-9e1d-a4248ce9af9c tempest-VolumesTestJSON-1822316371 tempest-VolumesTestJSON-1822316371-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.124676 Jun 30 17:53:09.158571 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 27/63] 10.222.0.16 () {58 vars in 1154 bytes} [Thu Jun 30 17:53:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:09.181508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-edc145a5-3bfc-454d-901a-dbc5ec399413 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:09.182293 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-edc145a5-3bfc-454d-901a-dbc5ec399413 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:09.195729 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-edc145a5-3bfc-454d-901a-dbc5ec399413 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:09.199022 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-edc145a5-3bfc-454d-901a-dbc5ec399413 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:09.202567 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-edc145a5-3bfc-454d-901a-dbc5ec399413 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:09.204011 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-edc145a5-3bfc-454d-901a-dbc5ec399413 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:09.335300 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-edc145a5-3bfc-454d-901a-dbc5ec399413 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:09.358538 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-edc145a5-3bfc-454d-901a-dbc5ec399413 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1237 microversion: 2.1 time: 0.182322 Jun 30 17:53:09.363616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 28/64] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:09 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1237 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:09.449577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c3f923bc-3af5-4702-8d73-737d2300d4d8 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:09.459608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c3f923bc-3af5-4702-8d73-737d2300d4d8 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.343703 Jun 30 17:53:09.460753 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 37/65] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:09 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:53:09.716072 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:09.716766 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:09.723982 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:09.724432 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:09.725194 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:09.728499 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:09.819778 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:09.829532 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:09.832011 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:09.833142 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3d97a33e-51c3-4ca7-b7f3-48d18c0e0035 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1333 microversion: 2.20 time: 0.121041 Jun 30 17:53:09.833697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 29/66] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:09 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1333 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:10.379649 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-68f455e4-0989-4c72-8870-13b8794771ec tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:10.380282 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-68f455e4-0989-4c72-8870-13b8794771ec tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:10.386464 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-68f455e4-0989-4c72-8870-13b8794771ec tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:10.386940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-68f455e4-0989-4c72-8870-13b8794771ec tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:10.387735 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-68f455e4-0989-4c72-8870-13b8794771ec tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:10.388222 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-68f455e4-0989-4c72-8870-13b8794771ec tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:10.450623 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-68f455e4-0989-4c72-8870-13b8794771ec tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:10.460348 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-68f455e4-0989-4c72-8870-13b8794771ec tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1237 microversion: 2.1 time: 0.084477 Jun 30 17:53:10.460866 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 38/67] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:10 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:10.478655 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c7f8a8cc-fe6e-4453-9f3f-7da4ea759cfa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:10.479263 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c7f8a8cc-fe6e-4453-9f3f-7da4ea759cfa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:10.485396 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c7f8a8cc-fe6e-4453-9f3f-7da4ea759cfa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:10.485841 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c7f8a8cc-fe6e-4453-9f3f-7da4ea759cfa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:10.486616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c7f8a8cc-fe6e-4453-9f3f-7da4ea759cfa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:10.487047 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c7f8a8cc-fe6e-4453-9f3f-7da4ea759cfa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:10.642683 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-c7f8a8cc-fe6e-4453-9f3f-7da4ea759cfa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:10.651001 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-c7f8a8cc-fe6e-4453-9f3f-7da4ea759cfa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.175783 Jun 30 17:53:10.651587 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 30/68] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:10 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:10.854273 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:10.855328 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:10.871927 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:10.872776 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:10.874230 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:10.874947 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:10.954708 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:10.965847 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:10.967686 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:10.968839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c16e54bc-2fa3-4175-9f86-8b5430cd9f6e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1333 microversion: 2.20 time: 0.122223 Jun 30 17:53:10.969423 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 39/69] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:10 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:11.477078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-16c85425-235e-41d7-95b6-8b5011d68f7e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:11.478428 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-16c85425-235e-41d7-95b6-8b5011d68f7e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:11.485605 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16c85425-235e-41d7-95b6-8b5011d68f7e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:11.486265 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16c85425-235e-41d7-95b6-8b5011d68f7e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:11.487967 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16c85425-235e-41d7-95b6-8b5011d68f7e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:11.488645 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16c85425-235e-41d7-95b6-8b5011d68f7e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:11.669292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2c29b5c0-734b-4b11-a62e-6d2341660c16 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:11.669977 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-2c29b5c0-734b-4b11-a62e-6d2341660c16 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:11.677780 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2c29b5c0-734b-4b11-a62e-6d2341660c16 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:11.678304 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2c29b5c0-734b-4b11-a62e-6d2341660c16 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:11.679183 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2c29b5c0-734b-4b11-a62e-6d2341660c16 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:11.679694 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2c29b5c0-734b-4b11-a62e-6d2341660c16 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:11.713255 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-16c85425-235e-41d7-95b6-8b5011d68f7e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:11.720753 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-16c85425-235e-41d7-95b6-8b5011d68f7e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1237 microversion: 2.1 time: 0.247601 Jun 30 17:53:11.730131 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 31/70] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:11 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1237 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:11.812190 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2c29b5c0-734b-4b11-a62e-6d2341660c16 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:11.820510 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2c29b5c0-734b-4b11-a62e-6d2341660c16 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.155498 Jun 30 17:53:11.821086 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 40/71] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:11 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:11.989078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:11.989569 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:11.996079 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:11.996544 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:11.997303 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:11.997746 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:12.077521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:12.086755 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:12.088921 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:12.090307 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-be646f71-cda2-4aa5-a9cb-d879322a437e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1333 microversion: 2.20 time: 0.106246 Jun 30 17:53:12.091424 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 32/72] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:11 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1333 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:12.736964 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-367b286d-a324-4816-a455-9f963484fe6f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:12.737639 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-367b286d-a324-4816-a455-9f963484fe6f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:12.743771 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-367b286d-a324-4816-a455-9f963484fe6f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:12.744223 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-367b286d-a324-4816-a455-9f963484fe6f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:12.744995 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-367b286d-a324-4816-a455-9f963484fe6f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:12.745437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-367b286d-a324-4816-a455-9f963484fe6f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:12.818367 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-367b286d-a324-4816-a455-9f963484fe6f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:12.828692 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-367b286d-a324-4816-a455-9f963484fe6f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1237 microversion: 2.1 time: 0.095556 Jun 30 17:53:12.829378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 41/73] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:12 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:12.844755 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c1c3217f-4558-46d4-9445-4694f9fb5aea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:12.845366 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c1c3217f-4558-46d4-9445-4694f9fb5aea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:12.851800 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c1c3217f-4558-46d4-9445-4694f9fb5aea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:12.852231 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c1c3217f-4558-46d4-9445-4694f9fb5aea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:12.852981 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c1c3217f-4558-46d4-9445-4694f9fb5aea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:12.853415 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c1c3217f-4558-46d4-9445-4694f9fb5aea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:13.029115 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-c1c3217f-4558-46d4-9445-4694f9fb5aea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:13.039680 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-c1c3217f-4558-46d4-9445-4694f9fb5aea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.198613 Jun 30 17:53:13.050697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 33/74] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:12 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:53:13.109223 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:13.110047 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:13.117270 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:13.117724 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:13.118794 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:13.119544 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:13.200515 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:13.216693 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:13.221107 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:13.223039 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3db5b2ae-7a44-45e3-a4fa-02a3a0f0fce9 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1333 microversion: 2.20 time: 0.117766 Jun 30 17:53:13.226015 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 42/75] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:13 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1333 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:13.848205 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b1ddbcba-12c5-4058-8110-e9124ac5f1ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:13.848887 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b1ddbcba-12c5-4058-8110-e9124ac5f1ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:13.866185 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ddbcba-12c5-4058-8110-e9124ac5f1ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:13.866588 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ddbcba-12c5-4058-8110-e9124ac5f1ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:13.867396 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ddbcba-12c5-4058-8110-e9124ac5f1ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:13.867851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ddbcba-12c5-4058-8110-e9124ac5f1ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:14.001317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b1ddbcba-12c5-4058-8110-e9124ac5f1ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:14.015191 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b1ddbcba-12c5-4058-8110-e9124ac5f1ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1237 microversion: 2.1 time: 0.171188 Jun 30 17:53:14.020381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 34/76] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:13 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1237 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:14.057233 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4d3196ab-0c55-4115-a024-b7779a8dd874 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:14.057882 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4d3196ab-0c55-4115-a024-b7779a8dd874 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:14.073008 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4d3196ab-0c55-4115-a024-b7779a8dd874 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:14.073783 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4d3196ab-0c55-4115-a024-b7779a8dd874 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:14.074536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4d3196ab-0c55-4115-a024-b7779a8dd874 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:14.075705 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4d3196ab-0c55-4115-a024-b7779a8dd874 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:14.248149 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:14.249102 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:14.276829 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:14.279476 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:14.283221 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:14.292644 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:14.559880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4d3196ab-0c55-4115-a024-b7779a8dd874 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:14.578174 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:14.583223 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4d3196ab-0c55-4115-a024-b7779a8dd874 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.529964 Jun 30 17:53:14.600983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 43/77] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:14 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:14.604318 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:14.608850 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:14.612918 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2f58220f-385d-42ac-a573-bedaa8995443 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1333 microversion: 2.20 time: 0.374287 Jun 30 17:53:14.613946 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 35/78] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:14 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1333 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:15.036883 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b1d6006c-5f18-48c4-9fa0-67e17c711a75 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:15.037503 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b1d6006c-5f18-48c4-9fa0-67e17c711a75 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:15.055907 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b1d6006c-5f18-48c4-9fa0-67e17c711a75 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:15.056421 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b1d6006c-5f18-48c4-9fa0-67e17c711a75 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:15.057233 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b1d6006c-5f18-48c4-9fa0-67e17c711a75 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:15.057665 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b1d6006c-5f18-48c4-9fa0-67e17c711a75 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:15.182794 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b1d6006c-5f18-48c4-9fa0-67e17c711a75 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:15.190021 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b1d6006c-5f18-48c4-9fa0-67e17c711a75 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1293 microversion: 2.1 time: 0.157521 Jun 30 17:53:15.201777 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 44/79] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:15 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1293 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:15.602758 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2d2c35db-9265-4518-9ba2-c17f64bd2b9b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:15.603480 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2d2c35db-9265-4518-9ba2-c17f64bd2b9b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:15.617910 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2d2c35db-9265-4518-9ba2-c17f64bd2b9b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:15.621464 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2d2c35db-9265-4518-9ba2-c17f64bd2b9b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:15.637375 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:15.638179 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:15.642467 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2d2c35db-9265-4518-9ba2-c17f64bd2b9b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:15.647139 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2d2c35db-9265-4518-9ba2-c17f64bd2b9b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:15.665790 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:15.667286 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:15.672591 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:15.675789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:15.997991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:16.042791 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:16.053788 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:16.056503 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:16.058209 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-cc1040e4-32bf-4f95-a5d5-9a255e6436a5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1339 microversion: 2.20 time: 0.428387 Jun 30 17:53:16.059891 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 45/80] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:15 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1339 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:16.121989 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=4 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:16.210658 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3c33d825-05c5-4108-8c3f-5cd751e107b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:16.211366 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3c33d825-05c5-4108-8c3f-5cd751e107b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:16.225640 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3c33d825-05c5-4108-8c3f-5cd751e107b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:16.226093 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3c33d825-05c5-4108-8c3f-5cd751e107b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:16.226904 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3c33d825-05c5-4108-8c3f-5cd751e107b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:16.227333 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3c33d825-05c5-4108-8c3f-5cd751e107b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:16.446447 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3c33d825-05c5-4108-8c3f-5cd751e107b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:16.485672 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3c33d825-05c5-4108-8c3f-5cd751e107b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1299 microversion: 2.1 time: 0.279631 Jun 30 17:53:16.486852 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 46/81] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:16 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:17.059644 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2d2c35db-9265-4518-9ba2-c17f64bd2b9b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:17.068567 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2d2c35db-9265-4518-9ba2-c17f64bd2b9b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 1.470817 Jun 30 17:53:17.069141 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 36/82] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:15 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:17.077775 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:17.079675 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:17.096604 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:17.099203 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:17.100451 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:17.102979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:17.161082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=12 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:17.506235 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1afaca33-6652-4c96-8f79-15c7879b62cb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:17.507120 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1afaca33-6652-4c96-8f79-15c7879b62cb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:17.520453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1afaca33-6652-4c96-8f79-15c7879b62cb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:17.524260 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1afaca33-6652-4c96-8f79-15c7879b62cb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:17.525690 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1afaca33-6652-4c96-8f79-15c7879b62cb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:17.526264 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1afaca33-6652-4c96-8f79-15c7879b62cb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:17.732454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:17.749376 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:17.760956 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:17.766789 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1afaca33-6652-4c96-8f79-15c7879b62cb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:17.767297 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-96e9372b-2888-41d9-ae18-5b5d0df78608 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1339 microversion: 2.20 time: 0.691457 Jun 30 17:53:17.772272 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 47/83] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:17 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1339 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:17.785456 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1afaca33-6652-4c96-8f79-15c7879b62cb tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1299 microversion: 2.1 time: 0.284695 Jun 30 17:53:17.798152 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 37/84] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:17 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1299 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:53:18.088470 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-16795f80-be30-4018-9ae2-39a3b391c8d9 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:18.089097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-16795f80-be30-4018-9ae2-39a3b391c8d9 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:18.128753 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-f5050fa4-078e-4021-925b-52fa2785b7aa req-3093751f-6eea-4c96-8894-269e06b50b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd", "tag": "6e3e7e62-f8a8-490e-b7ff-ef7783951136"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:18.136546 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16795f80-be30-4018-9ae2-39a3b391c8d9 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:18.138262 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16795f80-be30-4018-9ae2-39a3b391c8d9 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:18.157853 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16795f80-be30-4018-9ae2-39a3b391c8d9 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:18.180850 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16795f80-be30-4018-9ae2-39a3b391c8d9 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:18.182004 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=22 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:18.217071 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f5050fa4-078e-4021-925b-52fa2785b7aa req-3093751f-6eea-4c96-8894-269e06b50b86 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:18.220490 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f5050fa4-078e-4021-925b-52fa2785b7aa req-3093751f-6eea-4c96-8894-269e06b50b86 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:18.310915 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-f5050fa4-078e-4021-925b-52fa2785b7aa req-3093751f-6eea-4c96-8894-269e06b50b86 service nova] Creating event network-changed:6e3e7e62-f8a8-490e-b7ff-ef7783951136 for instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd on hv-cinder-81268 Jun 30 17:53:18.315214 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f5050fa4-078e-4021-925b-52fa2785b7aa req-3093751f-6eea-4c96-8894-269e06b50b86 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129370) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 17:53:18.322024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d6f33fb7-cd11-48bd-8cd8-14b2349fa0cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:18.322927 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d6f33fb7-cd11-48bd-8cd8-14b2349fa0cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:18.328529 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d6f33fb7-cd11-48bd-8cd8-14b2349fa0cd None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:18.329301 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d6f33fb7-cd11-48bd-8cd8-14b2349fa0cd None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:18.361606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.compute.rpcapi [None req-d6f33fb7-cd11-48bd-8cd8-14b2349fa0cd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 17:53:18.365750 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d6f33fb7-cd11-48bd-8cd8-14b2349fa0cd None None] Releasing lock "compute-rpcapi-router" {{(pid=129370) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 17:53:18.414039 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d6f33fb7-cd11-48bd-8cd8-14b2349fa0cd None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.639431 Jun 30 17:53:18.415020 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 48/85] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:18.793273 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:18.794138 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:18.822889 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:18.823084 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:18.835196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:18.835573 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:19.737059 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:19.754657 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:19.756667 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:19.757905 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b0086493-dc5d-428c-bb3f-829e92bfb183 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.971941 Jun 30 17:53:19.762092 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 49/86] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:18 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:53:19.774519 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-94fb3213-2f0e-4de1-8796-1c7fb7423d58 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:19.775269 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-94fb3213-2f0e-4de1-8796-1c7fb7423d58 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:19.796669 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-94fb3213-2f0e-4de1-8796-1c7fb7423d58 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:19.798956 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-94fb3213-2f0e-4de1-8796-1c7fb7423d58 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:19.800324 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-94fb3213-2f0e-4de1-8796-1c7fb7423d58 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:19.802509 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-94fb3213-2f0e-4de1-8796-1c7fb7423d58 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:19.899454 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-16795f80-be30-4018-9ae2-39a3b391c8d9 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:19.920476 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-16795f80-be30-4018-9ae2-39a3b391c8d9 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 1.838529 Jun 30 17:53:19.925922 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 38/87] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:18 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:53:20.275796 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-94fb3213-2f0e-4de1-8796-1c7fb7423d58 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:20.286893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-94fb3213-2f0e-4de1-8796-1c7fb7423d58 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.523574 Jun 30 17:53:20.288258 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 50/88] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:19 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:20.786701 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:20.787855 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:20.807094 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:20.807572 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:20.809736 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:20.813657 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:20.946412 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-63f3901d-61a4-470e-a4e7-e739546b5ffa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:20.947118 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-63f3901d-61a4-470e-a4e7-e739546b5ffa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:20.956928 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-63f3901d-61a4-470e-a4e7-e739546b5ffa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:20.957371 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-63f3901d-61a4-470e-a4e7-e739546b5ffa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:20.962284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-63f3901d-61a4-470e-a4e7-e739546b5ffa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:20.970975 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-63f3901d-61a4-470e-a4e7-e739546b5ffa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:21.048035 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=100 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:21.849609 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-63f3901d-61a4-470e-a4e7-e739546b5ffa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:21.861286 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-63f3901d-61a4-470e-a4e7-e739546b5ffa tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.918503 Jun 30 17:53:21.861803 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 51/89] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:20 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:21.889268 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8ca4bc3a-f9c3-40c6-9771-579e8b1bde19 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:21.899509 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8ca4bc3a-f9c3-40c6-9771-579e8b1bde19 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:21.906060 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:21.926301 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:21.937016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:21.939263 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8ca4bc3a-f9c3-40c6-9771-579e8b1bde19 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:21.939938 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8ca4bc3a-f9c3-40c6-9771-579e8b1bde19 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:21.941417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8ca4bc3a-f9c3-40c6-9771-579e8b1bde19 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:21.943932 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8ca4bc3a-f9c3-40c6-9771-579e8b1bde19 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:21.945404 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-e94b8175-1ab1-4bae-b0f3-55bd48688aa6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 1.163390 Jun 30 17:53:21.949487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 39/90] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:20 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:22.319048 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8ca4bc3a-f9c3-40c6-9771-579e8b1bde19 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:22.328567 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8ca4bc3a-f9c3-40c6-9771-579e8b1bde19 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.443045 Jun 30 17:53:22.337995 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 52/91] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:21 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:22.880911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-58f7efc3-834a-4ba4-9309-2bc960ffb6ad tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:22.881527 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-58f7efc3-834a-4ba4-9309-2bc960ffb6ad tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:22.892761 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-58f7efc3-834a-4ba4-9309-2bc960ffb6ad tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:22.893909 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-58f7efc3-834a-4ba4-9309-2bc960ffb6ad tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:22.894855 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-58f7efc3-834a-4ba4-9309-2bc960ffb6ad tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:22.895492 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-58f7efc3-834a-4ba4-9309-2bc960ffb6ad tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:22.967575 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:22.968440 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:22.990085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:22.990085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:22.990085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:22.990085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:23.407119 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-58f7efc3-834a-4ba4-9309-2bc960ffb6ad tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:23.438295 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:23.448012 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-58f7efc3-834a-4ba4-9309-2bc960ffb6ad tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.563004 Jun 30 17:53:23.454729 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:23.460429 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:23.462001 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8b4ffad7-fac6-4783-8b97-7f22bb2d821c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.499233 Jun 30 17:53:23.462111 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 40/92] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:22 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:23.474052 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 53/93] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:22 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:53:23.478387 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1a10183e-c31b-4a39-ac9b-012a9b6e5483 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:23.482978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1a10183e-c31b-4a39-ac9b-012a9b6e5483 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:23.491745 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1a10183e-c31b-4a39-ac9b-012a9b6e5483 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:23.492675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1a10183e-c31b-4a39-ac9b-012a9b6e5483 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:23.493726 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1a10183e-c31b-4a39-ac9b-012a9b6e5483 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:23.494269 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1a10183e-c31b-4a39-ac9b-012a9b6e5483 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:23.877279 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1a10183e-c31b-4a39-ac9b-012a9b6e5483 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:23.887122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1a10183e-c31b-4a39-ac9b-012a9b6e5483 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.416764 Jun 30 17:53:23.892518 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 41/94] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:23 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:23.998669 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-59bc1690-f46d-423b-b7b3-bc70f2a6b8a1 req-32cb28e8-6cf1-4337-b23c-a8e6c1ecee61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced4f642-e357-49ac-abac-c606c2e747bf", "tag": "08fa2453-7635-41ad-bc50-b2aec4e2fd7f"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:24.007840 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:24.012013 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-59bc1690-f46d-423b-b7b3-bc70f2a6b8a1 req-32cb28e8-6cf1-4337-b23c-a8e6c1ecee61 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:24.012691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-59bc1690-f46d-423b-b7b3-bc70f2a6b8a1 req-32cb28e8-6cf1-4337-b23c-a8e6c1ecee61 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:24.029597 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-59bc1690-f46d-423b-b7b3-bc70f2a6b8a1 req-32cb28e8-6cf1-4337-b23c-a8e6c1ecee61 service nova] Creating event network-changed:08fa2453-7635-41ad-bc50-b2aec4e2fd7f for instance ced4f642-e357-49ac-abac-c606c2e747bf on hv-cinder-81268 Jun 30 17:53:24.037577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-59bc1690-f46d-423b-b7b3-bc70f2a6b8a1 req-32cb28e8-6cf1-4337-b23c-a8e6c1ecee61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275405 Jun 30 17:53:24.039309 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 54/95] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:53:24.470725 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-71ea1a92-6013-4a05-aa3b-70446be10a1d tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:24.472871 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-71ea1a92-6013-4a05-aa3b-70446be10a1d tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:24.481657 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-71ea1a92-6013-4a05-aa3b-70446be10a1d tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:24.482372 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-71ea1a92-6013-4a05-aa3b-70446be10a1d tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:24.482585 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:24.483183 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:24.484039 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-71ea1a92-6013-4a05-aa3b-70446be10a1d tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:24.485573 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-71ea1a92-6013-4a05-aa3b-70446be10a1d tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:24.496590 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:24.497038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:24.497978 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:24.498281 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:24.694652 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-71ea1a92-6013-4a05-aa3b-70446be10a1d tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:24.698620 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=100 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:24.703637 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-71ea1a92-6013-4a05-aa3b-70446be10a1d tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.238097 Jun 30 17:53:24.716428 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 42/96] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:24 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:24.799110 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:24.811733 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:24.813230 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:24.819531 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-77b9d934-e229-4df9-a9ee-434f8a17456e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.337686 Jun 30 17:53:24.820936 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 55/97] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:24 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:24.909582 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-e79c5541-172d-442d-8e6b-0b0dfaf4b0c5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:24.910199 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-e79c5541-172d-442d-8e6b-0b0dfaf4b0c5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:24.919503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:24.920999 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e79c5541-172d-442d-8e6b-0b0dfaf4b0c5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:24.921446 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e79c5541-172d-442d-8e6b-0b0dfaf4b0c5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:24.922220 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e79c5541-172d-442d-8e6b-0b0dfaf4b0c5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:24.928243 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e79c5541-172d-442d-8e6b-0b0dfaf4b0c5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:25.216878 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e79c5541-172d-442d-8e6b-0b0dfaf4b0c5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:25.227768 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-e79c5541-172d-442d-8e6b-0b0dfaf4b0c5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.322868 Jun 30 17:53:25.229254 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 43/98] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:24 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:25.724155 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e444c241-8c21-471b-8713-438b3dc77713 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:25.733663 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e444c241-8c21-471b-8713-438b3dc77713 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:25.741115 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e444c241-8c21-471b-8713-438b3dc77713 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:25.741734 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e444c241-8c21-471b-8713-438b3dc77713 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:25.742687 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e444c241-8c21-471b-8713-438b3dc77713 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:25.743259 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e444c241-8c21-471b-8713-438b3dc77713 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:25.839599 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:25.840283 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:25.854211 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:25.854689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:25.855467 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:25.855902 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:25.978916 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e444c241-8c21-471b-8713-438b3dc77713 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:25.998377 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e444c241-8c21-471b-8713-438b3dc77713 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.279230 Jun 30 17:53:26.008892 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 56/99] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:25 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:26.058132 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-a37b9abd-862b-461b-bd0c-b47d285778d4 req-4005a68c-49b0-4283-aee3-ad629bca5e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed940450-c1a0-4aea-9b4b-65d90d495225", "tag": "321ba8b4-47c5-40f5-88f0-2fd84bc02ee5"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:26.075349 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-a37b9abd-862b-461b-bd0c-b47d285778d4 req-4005a68c-49b0-4283-aee3-ad629bca5e39 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:26.076142 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-a37b9abd-862b-461b-bd0c-b47d285778d4 req-4005a68c-49b0-4283-aee3-ad629bca5e39 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:26.100710 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-a37b9abd-862b-461b-bd0c-b47d285778d4 req-4005a68c-49b0-4283-aee3-ad629bca5e39 service nova] Creating event network-changed:321ba8b4-47c5-40f5-88f0-2fd84bc02ee5 for instance ed940450-c1a0-4aea-9b4b-65d90d495225 on hv-cinder-81268 Jun 30 17:53:26.106575 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-a37b9abd-862b-461b-bd0c-b47d285778d4 req-4005a68c-49b0-4283-aee3-ad629bca5e39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052593 Jun 30 17:53:26.107950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 57/100] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:26.180343 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:26.201547 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:26.203094 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:26.204235 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-8c6da760-e26e-49a5-a0bb-4e412bf687a4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.369123 Jun 30 17:53:26.204797 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 44/101] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:25 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:26.249769 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-87c77d58-cc76-4b62-95aa-deb87dd475dd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:26.250510 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-87c77d58-cc76-4b62-95aa-deb87dd475dd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:26.263437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-87c77d58-cc76-4b62-95aa-deb87dd475dd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:26.264460 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-87c77d58-cc76-4b62-95aa-deb87dd475dd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:26.265382 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-87c77d58-cc76-4b62-95aa-deb87dd475dd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:26.265899 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-87c77d58-cc76-4b62-95aa-deb87dd475dd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:26.435622 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-87c77d58-cc76-4b62-95aa-deb87dd475dd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:26.445283 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-87c77d58-cc76-4b62-95aa-deb87dd475dd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.203924 Jun 30 17:53:26.445868 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 58/102] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:26 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:27.016178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b1c8e556-d334-4d82-affd-7974d5a9df48 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:27.016899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b1c8e556-d334-4d82-affd-7974d5a9df48 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:27.023638 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1c8e556-d334-4d82-affd-7974d5a9df48 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:27.024208 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1c8e556-d334-4d82-affd-7974d5a9df48 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:27.025345 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1c8e556-d334-4d82-affd-7974d5a9df48 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:27.026045 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1c8e556-d334-4d82-affd-7974d5a9df48 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:27.222173 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:27.222968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:27.229527 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:27.230164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:27.231144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:27.231794 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:27.376374 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b1c8e556-d334-4d82-affd-7974d5a9df48 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:27.390845 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b1c8e556-d334-4d82-affd-7974d5a9df48 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.375115 Jun 30 17:53:27.391616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 45/103] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:27 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:27.464280 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5c5ea369-c0c8-4a61-aaf2-5f4813f00c3e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:27.464880 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5c5ea369-c0c8-4a61-aaf2-5f4813f00c3e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:27.472047 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5c5ea369-c0c8-4a61-aaf2-5f4813f00c3e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:27.472505 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5c5ea369-c0c8-4a61-aaf2-5f4813f00c3e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:27.479070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5c5ea369-c0c8-4a61-aaf2-5f4813f00c3e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:27.480049 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5c5ea369-c0c8-4a61-aaf2-5f4813f00c3e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:27.588706 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:27.606797 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:27.608740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:27.610025 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-bf62fe14-6adc-4d0c-965a-c5ec63609a3c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.393041 Jun 30 17:53:27.611130 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 59/104] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:27 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:27.888286 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-5c5ea369-c0c8-4a61-aaf2-5f4813f00c3e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:27.897454 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5c5ea369-c0c8-4a61-aaf2-5f4813f00c3e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.437970 Jun 30 17:53:27.898050 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 46/105] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:27 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:53:28.409113 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-50aa572c-39c2-4e75-b000-63ef5f0c2762 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:28.410272 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-50aa572c-39c2-4e75-b000-63ef5f0c2762 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:28.416830 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:28.419818 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-50aa572c-39c2-4e75-b000-63ef5f0c2762 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:28.421723 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-50aa572c-39c2-4e75-b000-63ef5f0c2762 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:28.425403 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-50aa572c-39c2-4e75-b000-63ef5f0c2762 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:28.426081 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-50aa572c-39c2-4e75-b000-63ef5f0c2762 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:28.592707 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-50aa572c-39c2-4e75-b000-63ef5f0c2762 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:28.603346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-50aa572c-39c2-4e75-b000-63ef5f0c2762 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.198595 Jun 30 17:53:28.604497 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 60/106] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:28 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:28.628050 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:28.629421 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:28.638160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:28.638639 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:28.639403 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:28.639832 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:28.830126 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:28.845764 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:28.847860 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:28.848975 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-99be6ef9-5300-4ae1-a29b-3e7ffa62b657 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.224962 Jun 30 17:53:28.849531 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 47/107] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:28 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:28.915096 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-324c294b-de2e-4779-9fc9-83caedd033c6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:28.916075 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-324c294b-de2e-4779-9fc9-83caedd033c6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:28.923201 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-324c294b-de2e-4779-9fc9-83caedd033c6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:28.924177 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-324c294b-de2e-4779-9fc9-83caedd033c6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:28.924586 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-324c294b-de2e-4779-9fc9-83caedd033c6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:28.925105 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-324c294b-de2e-4779-9fc9-83caedd033c6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:29.079367 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-324c294b-de2e-4779-9fc9-83caedd033c6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:29.088108 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-324c294b-de2e-4779-9fc9-83caedd033c6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.176719 Jun 30 17:53:29.089568 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 61/108] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:28 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:29.627110 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3c29ebd6-ced5-4509-8157-bdd2f971cfd2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:29.628788 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3c29ebd6-ced5-4509-8157-bdd2f971cfd2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:29.648987 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3c29ebd6-ced5-4509-8157-bdd2f971cfd2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:29.650682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3c29ebd6-ced5-4509-8157-bdd2f971cfd2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:29.653897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3c29ebd6-ced5-4509-8157-bdd2f971cfd2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:29.654410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3c29ebd6-ced5-4509-8157-bdd2f971cfd2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:29.884325 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:29.888169 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:29.930205 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:29.931551 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:29.940507 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:29.941774 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:29.951760 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3c29ebd6-ced5-4509-8157-bdd2f971cfd2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:29.993360 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3c29ebd6-ced5-4509-8157-bdd2f971cfd2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.370485 Jun 30 17:53:29.997915 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 48/109] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:29 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:30.108113 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-415c0464-2b9a-4de1-94d9-99c0472f5937 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:30.109571 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-415c0464-2b9a-4de1-94d9-99c0472f5937 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:30.139518 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-415c0464-2b9a-4de1-94d9-99c0472f5937 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:30.140774 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-415c0464-2b9a-4de1-94d9-99c0472f5937 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:30.144033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-415c0464-2b9a-4de1-94d9-99c0472f5937 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:30.147746 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-415c0464-2b9a-4de1-94d9-99c0472f5937 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:30.290485 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:30.302033 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:30.306659 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:30.309461 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-dc644cd5-3870-42b4-8ebf-651049d1093c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.445733 Jun 30 17:53:30.311596 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 62/110] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:29 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:53:30.503570 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-415c0464-2b9a-4de1-94d9-99c0472f5937 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:30.520792 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-415c0464-2b9a-4de1-94d9-99c0472f5937 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.419239 Jun 30 17:53:30.521081 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 49/111] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:30 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:31.015313 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-eecfb6c9-1ef1-460b-bbc9-6169e7eedf27 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:31.017363 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-eecfb6c9-1ef1-460b-bbc9-6169e7eedf27 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:31.036376 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eecfb6c9-1ef1-460b-bbc9-6169e7eedf27 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:31.036946 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eecfb6c9-1ef1-460b-bbc9-6169e7eedf27 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:31.042436 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eecfb6c9-1ef1-460b-bbc9-6169e7eedf27 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:31.042890 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eecfb6c9-1ef1-460b-bbc9-6169e7eedf27 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:31.196557 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-eecfb6c9-1ef1-460b-bbc9-6169e7eedf27 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:31.204184 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-eecfb6c9-1ef1-460b-bbc9-6169e7eedf27 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.195148 Jun 30 17:53:31.204928 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 63/112] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:31 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:31.329424 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:31.330095 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:31.336491 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:31.337177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:31.337928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:31.338390 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:31.482910 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:31.496736 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:31.498288 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:31.499478 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1df78d0a-2342-4a13-9a9b-e338aa93dd7d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.174053 Jun 30 17:53:31.500044 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 50/113] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:31 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:53:31.537469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7dd75a81-acbe-4e03-9654-ea611a7d8db2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:31.538435 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-7dd75a81-acbe-4e03-9654-ea611a7d8db2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:31.546661 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7dd75a81-acbe-4e03-9654-ea611a7d8db2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:31.547227 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7dd75a81-acbe-4e03-9654-ea611a7d8db2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:31.548055 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7dd75a81-acbe-4e03-9654-ea611a7d8db2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:31.548542 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7dd75a81-acbe-4e03-9654-ea611a7d8db2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:31.725971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-7dd75a81-acbe-4e03-9654-ea611a7d8db2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:31.744714 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-7dd75a81-acbe-4e03-9654-ea611a7d8db2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.211459 Jun 30 17:53:31.755509 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 64/114] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:31 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:32.221721 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2536135b-22c5-41b9-b449-1e7aeb3970d0 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:32.222361 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2536135b-22c5-41b9-b449-1e7aeb3970d0 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:32.228991 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2536135b-22c5-41b9-b449-1e7aeb3970d0 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:32.229427 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2536135b-22c5-41b9-b449-1e7aeb3970d0 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:32.230201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2536135b-22c5-41b9-b449-1e7aeb3970d0 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:32.230824 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2536135b-22c5-41b9-b449-1e7aeb3970d0 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:32.374427 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2536135b-22c5-41b9-b449-1e7aeb3970d0 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:32.384368 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2536135b-22c5-41b9-b449-1e7aeb3970d0 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.167151 Jun 30 17:53:32.394691 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 51/115] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:32 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:32.516851 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:32.517464 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:32.523460 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:32.523905 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:32.524684 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:32.525277 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:32.657558 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:32.665556 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:32.667108 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:32.668216 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-214ac608-52dd-4ac3-b3f5-e019acb24c32 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.155192 Jun 30 17:53:32.668769 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 65/116] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:32 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:32.763146 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c5d74eb6-f20a-48b1-87b5-ff3affe63fac tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:32.763767 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c5d74eb6-f20a-48b1-87b5-ff3affe63fac tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:32.772815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c5d74eb6-f20a-48b1-87b5-ff3affe63fac tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:32.773477 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c5d74eb6-f20a-48b1-87b5-ff3affe63fac tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:32.774473 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c5d74eb6-f20a-48b1-87b5-ff3affe63fac tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:32.774973 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c5d74eb6-f20a-48b1-87b5-ff3affe63fac tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:32.992495 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-c5d74eb6-f20a-48b1-87b5-ff3affe63fac tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:33.009652 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-c5d74eb6-f20a-48b1-87b5-ff3affe63fac tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.251885 Jun 30 17:53:33.010432 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 52/117] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:32 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:33.401310 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-15cac50f-79e0-47f2-b14d-660b767e6457 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:33.402194 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-15cac50f-79e0-47f2-b14d-660b767e6457 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:33.409637 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-15cac50f-79e0-47f2-b14d-660b767e6457 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:33.410088 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-15cac50f-79e0-47f2-b14d-660b767e6457 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:33.410876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-15cac50f-79e0-47f2-b14d-660b767e6457 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:33.411318 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-15cac50f-79e0-47f2-b14d-660b767e6457 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:33.548452 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-15cac50f-79e0-47f2-b14d-660b767e6457 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:33.556229 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-15cac50f-79e0-47f2-b14d-660b767e6457 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.159029 Jun 30 17:53:33.557014 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 66/118] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:33 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:33.686794 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:33.687909 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:33.694600 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:33.694917 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:33.696002 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:33.696531 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:33.840969 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:33.850653 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:33.852393 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:33.853595 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3e161b46-c97b-4df3-be48-d2f349fd6b58 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.170704 Jun 30 17:53:33.854226 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 53/119] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:33 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:34.026479 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-07194cb0-28bf-4a10-8556-0e5b7f8a94cf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:34.027095 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-07194cb0-28bf-4a10-8556-0e5b7f8a94cf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:34.032935 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-07194cb0-28bf-4a10-8556-0e5b7f8a94cf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:34.033428 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-07194cb0-28bf-4a10-8556-0e5b7f8a94cf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:34.034201 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-07194cb0-28bf-4a10-8556-0e5b7f8a94cf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:34.034660 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-07194cb0-28bf-4a10-8556-0e5b7f8a94cf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:34.169168 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-07194cb0-28bf-4a10-8556-0e5b7f8a94cf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:34.177301 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-07194cb0-28bf-4a10-8556-0e5b7f8a94cf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.154823 Jun 30 17:53:34.177902 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 67/120] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:34 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:34.573447 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-48ea70d8-038f-444f-b1fe-622ceb54d439 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:34.574147 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-48ea70d8-038f-444f-b1fe-622ceb54d439 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:34.581033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-48ea70d8-038f-444f-b1fe-622ceb54d439 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:34.581485 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-48ea70d8-038f-444f-b1fe-622ceb54d439 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:34.582552 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-48ea70d8-038f-444f-b1fe-622ceb54d439 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:34.583139 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-48ea70d8-038f-444f-b1fe-622ceb54d439 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:34.740767 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-48ea70d8-038f-444f-b1fe-622ceb54d439 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:34.754053 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-48ea70d8-038f-444f-b1fe-622ceb54d439 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.184140 Jun 30 17:53:34.755806 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 54/121] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:34 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:34.880499 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:34.881327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:34.889620 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:34.890392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:34.891494 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:34.892112 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:35.060363 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:35.069128 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:35.070745 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:35.071835 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4e24010f-f86c-405e-9ebe-9afa88f44a3b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.196741 Jun 30 17:53:35.072711 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 68/122] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:34 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:35.193871 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-dc7d3060-de23-4cbb-aeb1-0402ddbb10ed tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:35.194883 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-dc7d3060-de23-4cbb-aeb1-0402ddbb10ed tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:35.202522 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dc7d3060-de23-4cbb-aeb1-0402ddbb10ed tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:35.203249 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dc7d3060-de23-4cbb-aeb1-0402ddbb10ed tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:35.204377 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dc7d3060-de23-4cbb-aeb1-0402ddbb10ed tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:35.205037 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dc7d3060-de23-4cbb-aeb1-0402ddbb10ed tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:35.385684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-dc7d3060-de23-4cbb-aeb1-0402ddbb10ed tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:35.395722 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-dc7d3060-de23-4cbb-aeb1-0402ddbb10ed tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.206079 Jun 30 17:53:35.396862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 55/123] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:35 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:35.772187 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1f526f62-f43a-4176-84b5-3b099bfe8a82 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:35.773006 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1f526f62-f43a-4176-84b5-3b099bfe8a82 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:35.785556 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1f526f62-f43a-4176-84b5-3b099bfe8a82 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:35.785662 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1f526f62-f43a-4176-84b5-3b099bfe8a82 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:35.786459 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1f526f62-f43a-4176-84b5-3b099bfe8a82 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:35.786887 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1f526f62-f43a-4176-84b5-3b099bfe8a82 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:35.815718 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=100 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:35.961133 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1f526f62-f43a-4176-84b5-3b099bfe8a82 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:35.981324 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1f526f62-f43a-4176-84b5-3b099bfe8a82 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.213046 Jun 30 17:53:35.981912 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 69/124] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:35 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:36.090649 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:36.091261 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:36.098790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:36.099404 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:36.100471 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:36.101180 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:36.279649 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:36.294385 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:36.297438 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:36.300233 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2ed92ff5-35df-4b7e-99dc-0d74019cbcf6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.213326 Jun 30 17:53:36.302775 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 56/125] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:36 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:53:36.378443 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-87c9c614-ca8b-4bff-9f8c-28beb5f1ed31 req-b5404f1b-3937-4e63-846e-5875ea5cb246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd", "name": "network-vif-plugged", "status": "completed", "tag": "6e3e7e62-f8a8-490e-b7ff-ef7783951136"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:36.386782 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-87c9c614-ca8b-4bff-9f8c-28beb5f1ed31 req-b5404f1b-3937-4e63-846e-5875ea5cb246 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:36.387399 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-87c9c614-ca8b-4bff-9f8c-28beb5f1ed31 req-b5404f1b-3937-4e63-846e-5875ea5cb246 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:36.402715 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-87c9c614-ca8b-4bff-9f8c-28beb5f1ed31 req-b5404f1b-3937-4e63-846e-5875ea5cb246 service nova] Creating event network-vif-plugged:6e3e7e62-f8a8-490e-b7ff-ef7783951136 for instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd on hv-cinder-81268 Jun 30 17:53:36.414303 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a3eec7a7-569f-4b26-8eac-a73f442447bf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:36.414939 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a3eec7a7-569f-4b26-8eac-a73f442447bf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:36.419574 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-87c9c614-ca8b-4bff-9f8c-28beb5f1ed31 req-b5404f1b-3937-4e63-846e-5875ea5cb246 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196040 Jun 30 17:53:36.420390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 70/126] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:36.427201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a3eec7a7-569f-4b26-8eac-a73f442447bf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:36.428609 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a3eec7a7-569f-4b26-8eac-a73f442447bf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:36.429780 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a3eec7a7-569f-4b26-8eac-a73f442447bf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:36.430066 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a3eec7a7-569f-4b26-8eac-a73f442447bf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:36.578036 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a3eec7a7-569f-4b26-8eac-a73f442447bf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:36.586952 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a3eec7a7-569f-4b26-8eac-a73f442447bf tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.176804 Jun 30 17:53:36.588010 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 57/127] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:36 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:53:36.999646 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-14c2bdd5-36c5-4689-a7b9-58b756687283 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:37.000340 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-14c2bdd5-36c5-4689-a7b9-58b756687283 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:37.007163 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-14c2bdd5-36c5-4689-a7b9-58b756687283 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:37.007611 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-14c2bdd5-36c5-4689-a7b9-58b756687283 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:37.008374 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-14c2bdd5-36c5-4689-a7b9-58b756687283 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:37.008806 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-14c2bdd5-36c5-4689-a7b9-58b756687283 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:37.150650 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-14c2bdd5-36c5-4689-a7b9-58b756687283 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:37.162443 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-14c2bdd5-36c5-4689-a7b9-58b756687283 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.166715 Jun 30 17:53:37.163301 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 71/128] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:36 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:37.320507 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:37.321686 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:37.338151 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:37.338630 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:37.339420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:37.339852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:37.499729 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:37.507956 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:37.509641 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:37.510774 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-02c3ac7d-4463-4c8e-94a5-823512eb132e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.194085 Jun 30 17:53:37.511321 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 58/129] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:37 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:37.603963 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-48b2caa3-0625-413e-9117-dc85245dbe7c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:37.604724 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-48b2caa3-0625-413e-9117-dc85245dbe7c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:37.610786 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-48b2caa3-0625-413e-9117-dc85245dbe7c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:37.612010 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-48b2caa3-0625-413e-9117-dc85245dbe7c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:37.612862 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-48b2caa3-0625-413e-9117-dc85245dbe7c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:37.613384 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-48b2caa3-0625-413e-9117-dc85245dbe7c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:37.755796 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-48b2caa3-0625-413e-9117-dc85245dbe7c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:37.763150 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-48b2caa3-0625-413e-9117-dc85245dbe7c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.162901 Jun 30 17:53:37.763751 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 72/130] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:37 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:38.182282 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a6f65536-4a0e-4459-b892-b4d7c5acc0ea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:38.184325 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a6f65536-4a0e-4459-b892-b4d7c5acc0ea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:38.193799 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a6f65536-4a0e-4459-b892-b4d7c5acc0ea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:38.194272 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a6f65536-4a0e-4459-b892-b4d7c5acc0ea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:38.195062 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a6f65536-4a0e-4459-b892-b4d7c5acc0ea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:38.195712 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a6f65536-4a0e-4459-b892-b4d7c5acc0ea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:38.217598 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=100 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:38.335832 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a6f65536-4a0e-4459-b892-b4d7c5acc0ea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:38.343407 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a6f65536-4a0e-4459-b892-b4d7c5acc0ea tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.166198 Jun 30 17:53:38.344000 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 59/131] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:38 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:38.528030 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:38.528762 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:38.535388 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:38.535840 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:38.536600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:38.537037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:38.668432 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:38.677155 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:38.678897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:38.680146 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-23db659c-3948-4485-83ac-4545036663ee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.156325 Jun 30 17:53:38.680759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 73/132] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:38 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:38.779803 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d8a408d8-59d6-47b6-bf7d-721fca1a0ba3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:38.780420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d8a408d8-59d6-47b6-bf7d-721fca1a0ba3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:38.786507 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d8a408d8-59d6-47b6-bf7d-721fca1a0ba3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:38.786955 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d8a408d8-59d6-47b6-bf7d-721fca1a0ba3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:38.787717 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d8a408d8-59d6-47b6-bf7d-721fca1a0ba3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:38.788157 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d8a408d8-59d6-47b6-bf7d-721fca1a0ba3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:38.938143 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d8a408d8-59d6-47b6-bf7d-721fca1a0ba3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:38.945535 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d8a408d8-59d6-47b6-bf7d-721fca1a0ba3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.169589 Jun 30 17:53:38.946097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 60/133] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:38 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:39.360097 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-830f663e-245b-4c0a-acc8-ff16d4d025b5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:39.360705 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-830f663e-245b-4c0a-acc8-ff16d4d025b5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:39.366933 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-830f663e-245b-4c0a-acc8-ff16d4d025b5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:39.367381 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-830f663e-245b-4c0a-acc8-ff16d4d025b5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:39.368137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-830f663e-245b-4c0a-acc8-ff16d4d025b5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:39.368571 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-830f663e-245b-4c0a-acc8-ff16d4d025b5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:39.513662 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-830f663e-245b-4c0a-acc8-ff16d4d025b5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:39.522612 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-830f663e-245b-4c0a-acc8-ff16d4d025b5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.166186 Jun 30 17:53:39.523193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 74/134] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:39 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:39.698922 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:39.699579 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:39.706171 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:39.706667 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:39.707419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:39.707889 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:39.848215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:39.856356 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:39.857841 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:39.858955 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-c84ad582-43df-4052-b946-db80a5722121 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.164159 Jun 30 17:53:39.859506 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 61/135] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:39 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:39.962642 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1a138a52-ed41-4bd8-89e1-170904450749 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:39.963384 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1a138a52-ed41-4bd8-89e1-170904450749 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:39.970652 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1a138a52-ed41-4bd8-89e1-170904450749 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:39.971095 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1a138a52-ed41-4bd8-89e1-170904450749 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:39.971856 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1a138a52-ed41-4bd8-89e1-170904450749 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:39.972282 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1a138a52-ed41-4bd8-89e1-170904450749 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:40.135285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1a138a52-ed41-4bd8-89e1-170904450749 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:40.143050 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1a138a52-ed41-4bd8-89e1-170904450749 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.184285 Jun 30 17:53:40.143618 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 75/136] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:39 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:40.540534 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6e9e0014-342a-4f9b-9148-a09fcfc890be tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:40.541322 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6e9e0014-342a-4f9b-9148-a09fcfc890be tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:40.551395 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6e9e0014-342a-4f9b-9148-a09fcfc890be tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:40.552554 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6e9e0014-342a-4f9b-9148-a09fcfc890be tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:40.553479 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6e9e0014-342a-4f9b-9148-a09fcfc890be tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:40.554058 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6e9e0014-342a-4f9b-9148-a09fcfc890be tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:40.876749 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:40.877363 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:40.885744 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:40.886188 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:40.889430 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:40.889881 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:41.133803 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:41.143813 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:41.145424 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:41.146884 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-90633bd1-3bb0-4a38-8ab1-302d70cd862b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.273906 Jun 30 17:53:41.147363 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 76/137] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:40 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:41.163164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4265841c-66ea-4a24-9a98-253aad004eee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:41.164309 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4265841c-66ea-4a24-9a98-253aad004eee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:41.172176 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4265841c-66ea-4a24-9a98-253aad004eee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:41.173480 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4265841c-66ea-4a24-9a98-253aad004eee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:41.174998 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4265841c-66ea-4a24-9a98-253aad004eee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:41.175583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4265841c-66ea-4a24-9a98-253aad004eee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:41.249920 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6e9e0014-342a-4f9b-9148-a09fcfc890be tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:41.259176 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6e9e0014-342a-4f9b-9148-a09fcfc890be tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.723032 Jun 30 17:53:41.259832 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 62/138] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:40 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:41.366805 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4265841c-66ea-4a24-9a98-253aad004eee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:41.373386 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4265841c-66ea-4a24-9a98-253aad004eee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.215361 Jun 30 17:53:41.373964 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 77/139] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:41 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:42.165588 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:42.166186 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:42.172216 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:42.172660 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:42.174125 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:42.174614 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:42.281812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8e3901c3-f1e6-43ee-9423-25f2938f8d26 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:42.284952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8e3901c3-f1e6-43ee-9423-25f2938f8d26 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:42.295476 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8e3901c3-f1e6-43ee-9423-25f2938f8d26 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:42.296611 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8e3901c3-f1e6-43ee-9423-25f2938f8d26 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:42.297665 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8e3901c3-f1e6-43ee-9423-25f2938f8d26 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:42.298386 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8e3901c3-f1e6-43ee-9423-25f2938f8d26 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:42.344459 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:42.360888 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:42.363184 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:42.365905 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-af908009-da2c-4d3b-9082-8498f75118e3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.203002 Jun 30 17:53:42.366926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 63/140] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:42 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:42.393490 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a99b19e5-649a-4353-b29d-7a0adbbfbe12 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:42.394353 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a99b19e5-649a-4353-b29d-7a0adbbfbe12 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:42.402592 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a99b19e5-649a-4353-b29d-7a0adbbfbe12 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:42.404263 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a99b19e5-649a-4353-b29d-7a0adbbfbe12 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:42.405876 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a99b19e5-649a-4353-b29d-7a0adbbfbe12 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:42.406316 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a99b19e5-649a-4353-b29d-7a0adbbfbe12 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:42.497007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8e3901c3-f1e6-43ee-9423-25f2938f8d26 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:42.509361 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8e3901c3-f1e6-43ee-9423-25f2938f8d26 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1314 microversion: 2.1 time: 0.234172 Jun 30 17:53:42.510273 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 78/141] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:42 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:42.727747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a99b19e5-649a-4353-b29d-7a0adbbfbe12 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:42.743103 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a99b19e5-649a-4353-b29d-7a0adbbfbe12 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.355136 Jun 30 17:53:42.744126 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 64/142] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:42 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:53:43.360469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-05acfc83-c346-4050-bb03-77f702d0b518 req-8fb52cb4-d5ef-41d7-9a8f-9963bc9ac269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced4f642-e357-49ac-abac-c606c2e747bf", "name": "network-vif-plugged", "status": "completed", "tag": "08fa2453-7635-41ad-bc50-b2aec4e2fd7f"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:43.384420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:43.386063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:43.392245 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-05acfc83-c346-4050-bb03-77f702d0b518 req-8fb52cb4-d5ef-41d7-9a8f-9963bc9ac269 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:43.394677 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-05acfc83-c346-4050-bb03-77f702d0b518 req-8fb52cb4-d5ef-41d7-9a8f-9963bc9ac269 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:43.397467 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:43.399259 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:43.400049 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:43.402402 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:43.414960 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-05acfc83-c346-4050-bb03-77f702d0b518 req-8fb52cb4-d5ef-41d7-9a8f-9963bc9ac269 service nova] Creating event network-vif-plugged:08fa2453-7635-41ad-bc50-b2aec4e2fd7f for instance ced4f642-e357-49ac-abac-c606c2e747bf on hv-cinder-81268 Jun 30 17:53:43.421084 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-05acfc83-c346-4050-bb03-77f702d0b518 req-8fb52cb4-d5ef-41d7-9a8f-9963bc9ac269 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066426 Jun 30 17:53:43.422030 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 79/143] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:53:43.538873 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c72012f7-4aa5-48a4-af46-b7c30300d374 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:43.540502 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c72012f7-4aa5-48a4-af46-b7c30300d374 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:43.560181 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c72012f7-4aa5-48a4-af46-b7c30300d374 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:43.561830 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c72012f7-4aa5-48a4-af46-b7c30300d374 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:43.563931 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c72012f7-4aa5-48a4-af46-b7c30300d374 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:43.564623 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c72012f7-4aa5-48a4-af46-b7c30300d374 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:43.682109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:43.694000 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:43.695837 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:43.697389 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2304a490-7fcc-4c95-b1ae-4ef23845ebeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.317148 Jun 30 17:53:43.697940 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 65/144] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:43 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:43.762408 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-61e85ee2-9c44-4f1c-8791-fd01a07c19bc tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:43.763356 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-61e85ee2-9c44-4f1c-8791-fd01a07c19bc tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:43.777709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-61e85ee2-9c44-4f1c-8791-fd01a07c19bc tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:43.779428 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-61e85ee2-9c44-4f1c-8791-fd01a07c19bc tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:43.780525 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-61e85ee2-9c44-4f1c-8791-fd01a07c19bc tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:43.781659 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-61e85ee2-9c44-4f1c-8791-fd01a07c19bc tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:43.800989 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c72012f7-4aa5-48a4-af46-b7c30300d374 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:43.815111 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c72012f7-4aa5-48a4-af46-b7c30300d374 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1501 microversion: 2.1 time: 0.283669 Jun 30 17:53:43.819338 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 80/145] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:43 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1501 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:44.032512 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-61e85ee2-9c44-4f1c-8791-fd01a07c19bc tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:44.048133 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-61e85ee2-9c44-4f1c-8791-fd01a07c19bc tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.290963 Jun 30 17:53:44.049541 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 66/146] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:43 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:44.719739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:44.720440 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:44.726957 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:44.727344 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:44.728406 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:44.728859 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:44.865966 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:44.874009 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:44.875543 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:44.876658 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-777fd06d-3c1d-47c6-89e6-c0ed8f0a96f4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.164252 Jun 30 17:53:44.877209 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 81/147] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:44 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:45.064760 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0e016d57-2117-4bf0-aaf0-034077662780 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:45.065463 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0e016d57-2117-4bf0-aaf0-034077662780 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:45.071513 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0e016d57-2117-4bf0-aaf0-034077662780 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:45.071955 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0e016d57-2117-4bf0-aaf0-034077662780 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:45.072712 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0e016d57-2117-4bf0-aaf0-034077662780 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:45.073414 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0e016d57-2117-4bf0-aaf0-034077662780 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:45.213782 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0e016d57-2117-4bf0-aaf0-034077662780 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:45.221994 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0e016d57-2117-4bf0-aaf0-034077662780 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.160977 Jun 30 17:53:45.222608 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 67/148] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:45 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:45.444444 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-cba3eb09-70c2-4448-bd1c-ab709299bcc1 req-2a7e1d27-d795-4f44-8794-3804dcbcc232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed940450-c1a0-4aea-9b4b-65d90d495225", "name": "network-vif-plugged", "status": "completed", "tag": "321ba8b4-47c5-40f5-88f0-2fd84bc02ee5"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:45.453515 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-cba3eb09-70c2-4448-bd1c-ab709299bcc1 req-2a7e1d27-d795-4f44-8794-3804dcbcc232 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:45.453922 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-cba3eb09-70c2-4448-bd1c-ab709299bcc1 req-2a7e1d27-d795-4f44-8794-3804dcbcc232 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:45.467208 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-cba3eb09-70c2-4448-bd1c-ab709299bcc1 req-2a7e1d27-d795-4f44-8794-3804dcbcc232 service nova] Creating event network-vif-plugged:321ba8b4-47c5-40f5-88f0-2fd84bc02ee5 for instance ed940450-c1a0-4aea-9b4b-65d90d495225 on hv-cinder-81268 Jun 30 17:53:45.472762 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-cba3eb09-70c2-4448-bd1c-ab709299bcc1 req-2a7e1d27-d795-4f44-8794-3804dcbcc232 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031970 Jun 30 17:53:45.473754 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 82/149] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:45.510345 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4212d8cc-ff2f-4aa2-93bb-63ba4219ace2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16becec5-f49d-417b-96ed-f344a3084f4f"}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:45.511482 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4212d8cc-ff2f-4aa2-93bb-63ba4219ace2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:45.517931 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4212d8cc-ff2f-4aa2-93bb-63ba4219ace2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:45.518394 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4212d8cc-ff2f-4aa2-93bb-63ba4219ace2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:45.519409 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4212d8cc-ff2f-4aa2-93bb-63ba4219ace2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:45.519836 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4212d8cc-ff2f-4aa2-93bb-63ba4219ace2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:45.674786 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4212d8cc-ff2f-4aa2-93bb-63ba4219ace2 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Acquired lock "compute-rpcapi-router" {{(pid=129371) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 17:53:45.675930 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d64cab7d-5857-4b65-a555-ca07d0de0a9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:45.676555 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d64cab7d-5857-4b65-a555-ca07d0de0a9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:45.677522 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d64cab7d-5857-4b65-a555-ca07d0de0a9a None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:45.677947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d64cab7d-5857-4b65-a555-ca07d0de0a9a None None] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:45.687399 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.compute.rpcapi [None req-d64cab7d-5857-4b65-a555-ca07d0de0a9a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 17:53:45.688274 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d64cab7d-5857-4b65-a555-ca07d0de0a9a None None] Releasing lock "compute-rpcapi-router" {{(pid=129371) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 17:53:45.897052 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:45.899063 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:45.907271 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:45.908010 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:45.909209 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:45.910104 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:46.072653 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d64cab7d-5857-4b65-a555-ca07d0de0a9a None None] 10.222.0.16 "POST /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566041 Jun 30 17:53:46.074202 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 68/150] 10.222.0.16 () {60 vars in 1322 bytes} [Thu Jun 30 17:53:45 2022] POST /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:46.111610 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:46.120869 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:46.122469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:46.124113 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3ae50a92-aece-4271-95c5-1e75b4930787 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1407 microversion: 2.20 time: 0.232239 Jun 30 17:53:46.124701 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 83/151] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:45 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 17:53:46.243532 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-beb4921b-8058-443c-8a03-721ebbcefb97 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:46.244364 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-beb4921b-8058-443c-8a03-721ebbcefb97 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:46.253554 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-beb4921b-8058-443c-8a03-721ebbcefb97 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:46.254021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-beb4921b-8058-443c-8a03-721ebbcefb97 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:46.255674 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-beb4921b-8058-443c-8a03-721ebbcefb97 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:46.256118 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-beb4921b-8058-443c-8a03-721ebbcefb97 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:46.445594 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-beb4921b-8058-443c-8a03-721ebbcefb97 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:46.465571 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-beb4921b-8058-443c-8a03-721ebbcefb97 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.221153 Jun 30 17:53:46.468340 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 69/152] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:46 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:53:47.141848 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:47.142679 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:47.149130 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:47.149627 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:47.150415 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:47.150897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:47.288304 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:47.296059 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:47.297535 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:47.298747 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-bdf4e340-ae8f-4a44-999f-d87c44ccd7e8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1598 microversion: 2.20 time: 0.160760 Jun 30 17:53:47.299320 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 84/153] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 17:53:47 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 17:53:47.316668 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6f32fd89-2e20-4393-b97e-fbbec9f82262 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:47.317153 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6f32fd89-2e20-4393-b97e-fbbec9f82262 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:47.323745 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f32fd89-2e20-4393-b97e-fbbec9f82262 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:47.324187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f32fd89-2e20-4393-b97e-fbbec9f82262 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:47.324927 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f32fd89-2e20-4393-b97e-fbbec9f82262 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:47.325355 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f32fd89-2e20-4393-b97e-fbbec9f82262 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:47.402076 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6f32fd89-2e20-4393-b97e-fbbec9f82262 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089648 Jun 30 17:53:47.402694 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 70/154] 10.222.0.16 () {60 vars in 1315 bytes} [Thu Jun 30 17:53:47 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:53:47.484314 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8c4c829b-d364-40ff-bba2-830246ec92ef tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:47.484915 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8c4c829b-d364-40ff-bba2-830246ec92ef tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:47.492025 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8c4c829b-d364-40ff-bba2-830246ec92ef tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:47.492469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8c4c829b-d364-40ff-bba2-830246ec92ef tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:47.493217 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8c4c829b-d364-40ff-bba2-830246ec92ef tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:47.493644 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8c4c829b-d364-40ff-bba2-830246ec92ef tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:47.668243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8c4c829b-d364-40ff-bba2-830246ec92ef tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:47.676893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8c4c829b-d364-40ff-bba2-830246ec92ef tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1366 microversion: 2.1 time: 0.196330 Jun 30 17:53:47.677749 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 85/155] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:47 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:48.695005 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-e9467a83-a37f-49f2-aabd-9508026aaf3c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:48.696198 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-e9467a83-a37f-49f2-aabd-9508026aaf3c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:48.702810 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e9467a83-a37f-49f2-aabd-9508026aaf3c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:48.703528 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e9467a83-a37f-49f2-aabd-9508026aaf3c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:48.704536 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e9467a83-a37f-49f2-aabd-9508026aaf3c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:48.705178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e9467a83-a37f-49f2-aabd-9508026aaf3c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:48.926572 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e9467a83-a37f-49f2-aabd-9508026aaf3c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:48.934507 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-e9467a83-a37f-49f2-aabd-9508026aaf3c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1554 microversion: 2.1 time: 0.243659 Jun 30 17:53:48.943890 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 71/156] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:48 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1554 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:48.952991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-717fe31a-cb21-4f92-ab63-d88ac0d73332 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:48.954539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-717fe31a-cb21-4f92-ab63-d88ac0d73332 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:48.963786 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-717fe31a-cb21-4f92-ab63-d88ac0d73332 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:48.964391 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-717fe31a-cb21-4f92-ab63-d88ac0d73332 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:48.965496 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-717fe31a-cb21-4f92-ab63-d88ac0d73332 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:48.966541 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-717fe31a-cb21-4f92-ab63-d88ac0d73332 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:49.004089 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-45d6390b-23c3-4d99-b775-3ffb6793fc1f req-f7a3f959-08be-42ef-bb18-2bc8226bacca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced4f642-e357-49ac-abac-c606c2e747bf", "tag": "08fa2453-7635-41ad-bc50-b2aec4e2fd7f"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:49.022018 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-45d6390b-23c3-4d99-b775-3ffb6793fc1f req-f7a3f959-08be-42ef-bb18-2bc8226bacca service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:49.022467 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-45d6390b-23c3-4d99-b775-3ffb6793fc1f req-f7a3f959-08be-42ef-bb18-2bc8226bacca service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:49.055546 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-45d6390b-23c3-4d99-b775-3ffb6793fc1f req-f7a3f959-08be-42ef-bb18-2bc8226bacca service nova] Creating event network-changed:08fa2453-7635-41ad-bc50-b2aec4e2fd7f for instance ced4f642-e357-49ac-abac-c606c2e747bf on hv-cinder-81268 Jun 30 17:53:49.063269 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-45d6390b-23c3-4d99-b775-3ffb6793fc1f req-f7a3f959-08be-42ef-bb18-2bc8226bacca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069816 Jun 30 17:53:49.071408 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 72/157] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:53:49.142025 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-717fe31a-cb21-4f92-ab63-d88ac0d73332 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187563 Jun 30 17:53:49.149326 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 86/158] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 17:53:48 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:50.962017 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-81d861ca-c8d5-46a6-8d37-38f083fd98ef req-f2fd7fd4-1471-4f4e-80e7-c6a778a4728a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed940450-c1a0-4aea-9b4b-65d90d495225", "tag": "321ba8b4-47c5-40f5-88f0-2fd84bc02ee5"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:53:50.980113 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-81d861ca-c8d5-46a6-8d37-38f083fd98ef req-f2fd7fd4-1471-4f4e-80e7-c6a778a4728a service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:50.980833 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-81d861ca-c8d5-46a6-8d37-38f083fd98ef req-f2fd7fd4-1471-4f4e-80e7-c6a778a4728a service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:51.020797 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-81d861ca-c8d5-46a6-8d37-38f083fd98ef req-f2fd7fd4-1471-4f4e-80e7-c6a778a4728a service nova] Creating event network-changed:321ba8b4-47c5-40f5-88f0-2fd84bc02ee5 for instance ed940450-c1a0-4aea-9b4b-65d90d495225 on hv-cinder-81268 Jun 30 17:53:51.039555 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-81d861ca-c8d5-46a6-8d37-38f083fd98ef req-f2fd7fd4-1471-4f4e-80e7-c6a778a4728a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082652 Jun 30 17:53:51.041475 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 73/159] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:53:58.297553 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a8da2925-50df-4755-af62-bad128f4ca9f tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:58.297553 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a8da2925-50df-4755-af62-bad128f4ca9f tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:58.300642 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=66 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:58.302152 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a8da2925-50df-4755-af62-bad128f4ca9f tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:58.302901 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a8da2925-50df-4755-af62-bad128f4ca9f tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:58.303694 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a8da2925-50df-4755-af62-bad128f4ca9f tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:58.304142 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a8da2925-50df-4755-af62-bad128f4ca9f tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:58.331214 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a8da2925-50df-4755-af62-bad128f4ca9f tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Going to try to terminate instance {{(pid=129370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 17:53:58.361006 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=100 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:58.435690 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a8da2925-50df-4755-af62-bad128f4ca9f tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 204 len: 0 microversion: 2.1 time: 0.146821 Jun 30 17:53:58.436192 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 87/160] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 17:53:58 2022] DELETE /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 17:53:58.444983 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3da751cf-3e5a-4fc8-9394-9dfd7fc15659 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:58.446301 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3da751cf-3e5a-4fc8-9394-9dfd7fc15659 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:58.448846 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:58.449668 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=62 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:53:58.454977 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3da751cf-3e5a-4fc8-9394-9dfd7fc15659 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:58.455446 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3da751cf-3e5a-4fc8-9394-9dfd7fc15659 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:58.456204 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3da751cf-3e5a-4fc8-9394-9dfd7fc15659 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:58.456634 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3da751cf-3e5a-4fc8-9394-9dfd7fc15659 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:58.600567 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3da751cf-3e5a-4fc8-9394-9dfd7fc15659 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:58.608365 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3da751cf-3e5a-4fc8-9394-9dfd7fc15659 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1553 microversion: 2.1 time: 0.167949 Jun 30 17:53:58.608915 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 74/161] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:58 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:53:59.626704 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-eb1db16d-b009-4ec2-a7bf-ba63079a414c tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:53:59.627805 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-eb1db16d-b009-4ec2-a7bf-ba63079a414c tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:53:59.642597 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eb1db16d-b009-4ec2-a7bf-ba63079a414c tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:59.643248 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eb1db16d-b009-4ec2-a7bf-ba63079a414c tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:59.644254 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eb1db16d-b009-4ec2-a7bf-ba63079a414c tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:53:59.644684 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-eb1db16d-b009-4ec2-a7bf-ba63079a414c tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:53:59.930377 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-eb1db16d-b009-4ec2-a7bf-ba63079a414c tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:53:59.942397 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-eb1db16d-b009-4ec2-a7bf-ba63079a414c tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1553 microversion: 2.1 time: 0.317054 Jun 30 17:53:59.949476 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 88/162] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:53:59 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:00.973266 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0b011c5e-2f0f-4530-a21a-0ed6aa704b66 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:00.977283 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0b011c5e-2f0f-4530-a21a-0ed6aa704b66 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:00.999316 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b011c5e-2f0f-4530-a21a-0ed6aa704b66 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:00.999773 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b011c5e-2f0f-4530-a21a-0ed6aa704b66 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:01.000558 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b011c5e-2f0f-4530-a21a-0ed6aa704b66 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:01.001004 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b011c5e-2f0f-4530-a21a-0ed6aa704b66 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:01.192770 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0b011c5e-2f0f-4530-a21a-0ed6aa704b66 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:01.204087 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0b011c5e-2f0f-4530-a21a-0ed6aa704b66 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1553 microversion: 2.1 time: 0.240405 Jun 30 17:54:01.204664 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 75/163] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:00 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:02.221961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c1c82b99-9911-4ab8-8b50-c8d3d64cc6ec tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:02.225406 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c1c82b99-9911-4ab8-8b50-c8d3d64cc6ec tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:02.245523 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c1c82b99-9911-4ab8-8b50-c8d3d64cc6ec tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:02.245966 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c1c82b99-9911-4ab8-8b50-c8d3d64cc6ec tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:02.247126 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c1c82b99-9911-4ab8-8b50-c8d3d64cc6ec tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:02.247550 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c1c82b99-9911-4ab8-8b50-c8d3d64cc6ec tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:02.376803 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-caf7ee8f-a765-44e8-970c-e14ce7750de3 req-4d567e95-babd-41d0-8a53-58071bfa8547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd", "name": "network-vif-deleted", "tag": "6e3e7e62-f8a8-490e-b7ff-ef7783951136"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:54:02.393659 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c1c82b99-9911-4ab8-8b50-c8d3d64cc6ec tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:02.404014 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-caf7ee8f-a765-44e8-970c-e14ce7750de3 req-4d567e95-babd-41d0-8a53-58071bfa8547 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:02.404459 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-caf7ee8f-a765-44e8-970c-e14ce7750de3 req-4d567e95-babd-41d0-8a53-58071bfa8547 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:02.404896 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c1c82b99-9911-4ab8-8b50-c8d3d64cc6ec tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1511 microversion: 2.1 time: 0.187732 Jun 30 17:54:02.405530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 89/164] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:02 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:02.413904 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:02.433786 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-caf7ee8f-a765-44e8-970c-e14ce7750de3 req-4d567e95-babd-41d0-8a53-58071bfa8547 service nova] Creating event network-vif-deleted:6e3e7e62-f8a8-490e-b7ff-ef7783951136 for instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd on hv-cinder-81268 Jun 30 17:54:02.443772 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-caf7ee8f-a765-44e8-970c-e14ce7750de3 req-4d567e95-babd-41d0-8a53-58071bfa8547 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073029 Jun 30 17:54:02.444332 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 76/165] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:54:03.426060 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:03.429213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:03.442144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:03.442687 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:03.443663 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:03.444163 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:03.483753 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:03.484292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:03.484825 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.objects.instance [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lazy-loading 'fault' on Instance uuid 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd {{(pid=129370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 17:54:03.551896 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a3c04395c64202b10451c270bac9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e3ea2346c743ef96f525d34c031848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:03.568944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ab9a2eab-fd93-46e5-8844-92f6c5cf58da tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 200 len: 1304 microversion: 2.1 time: 0.148603 Jun 30 17:54:03.579081 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 90/166] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:03 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 1304 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:04.587321 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:04.588537 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:04.595652 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:04.596503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:04.597449 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:04.598056 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:04.616336 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] HTTP exception thrown: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Request method failure captured: Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd HTTP/1.1 Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL5PGZ-Oj8ZFsT2oO05WwdtKzk2XiaGHQ7nbzmT9-vO38pGvsTD2VNNWqbU44hyo00kZ6ni9UKoyg6AaKGFAQMimrlO0yUyBD1tWs3ePydL1dyX1gjZY89UHLacl2r1jeGSEpLCNzp4PtVpykOCMV4fxyhzzqUTQNRnukxN0oHeaDw Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 66e3ea2346c743ef96f525d34c031848 Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 17:54:04.621236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66e3ea2346c743ef96f525d34c031848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66e3ea2346c743ef96f525d34c031848"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66e3ea2346c743ef96f525d34c031848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66e3ea2346c743ef96f525d34c031848"}]}] Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 66e3ea2346c743ef96f525d34c031848 Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-DeleteServersTestJSON-1676900660-project Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 52a3c04395c64202b10451c270bac9c5 Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-DeleteServersTestJSON-1676900660-project Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.622643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd'} Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:54:04.623344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.624508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.627613 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Returning 404 to user: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:54:04.628541 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-99ff59b6-ba86-4ae1-87d5-152674197667 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 404 len: 111 microversion: 2.1 time: 0.045339 Jun 30 17:54:04.629677 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 77/167] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:04 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:54:04.776708 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:04.778558 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:04.786631 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:04.787164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:04.787937 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:04.788360 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:04.803360 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] HTTP exception thrown: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Request method failure captured: Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd/os-volume_attachments HTTP/1.1 Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveL5PGZ-Oj8ZFsT2oO05WwdtKzk2XiaGHQ7nbzmT9-vO38pGvsTD2VNNWqbU44hyo00kZ6ni9UKoyg6AaKGFAQMimrlO0yUyBD1tWs3ePydL1dyX1gjZY89UHLacl2r1jeGSEpLCNzp4PtVpykOCMV4fxyhzzqUTQNRnukxN0oHeaDw Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 66e3ea2346c743ef96f525d34c031848 Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:54:04.807378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66e3ea2346c743ef96f525d34c031848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66e3ea2346c743ef96f525d34c031848"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66e3ea2346c743ef96f525d34c031848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66e3ea2346c743ef96f525d34c031848"}]}] Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 66e3ea2346c743ef96f525d34c031848 Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-DeleteServersTestJSON-1676900660-project Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 52a3c04395c64202b10451c270bac9c5 Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-DeleteServersTestJSON-1676900660-project Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.808555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'server_id': '26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd'} Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:54:04.809197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:04.810251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:04.812054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Returning 404 to user: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:54:04.813010 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-9f54bbf5-1fdb-487f-a0db-d30d287fcdf1 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040532 Jun 30 17:54:04.813567 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 91/168] 10.222.0.16 () {58 vars in 1301 bytes} [Thu Jun 30 17:54:04 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:54:06.044343 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:06.044883 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:06.056699 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:06.062096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:06.062965 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:06.063969 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:06.118963 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] HTTP exception thrown: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Request method failure captured: Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: DELETE /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd HTTP/1.1 Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL5PGZ-Oj8ZFsT2oO05WwdtKzk2XiaGHQ7nbzmT9-vO38pGvsTD2VNNWqbU44hyo00kZ6ni9UKoyg6AaKGFAQMimrlO0yUyBD1tWs3ePydL1dyX1gjZY89UHLacl2r1jeGSEpLCNzp4PtVpykOCMV4fxyhzzqUTQNRnukxN0oHeaDw Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 66e3ea2346c743ef96f525d34c031848 Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 17:54:06.127130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66e3ea2346c743ef96f525d34c031848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66e3ea2346c743ef96f525d34c031848"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66e3ea2346c743ef96f525d34c031848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66e3ea2346c743ef96f525d34c031848"}]}] Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 66e3ea2346c743ef96f525d34c031848 Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-DeleteServersTestJSON-1676900660-project Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 52a3c04395c64202b10451c270bac9c5 Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-DeleteServersTestJSON-1676900660-project Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.128346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd'} Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:54:06.128996 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.130098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.131177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Returning 404 to user: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:54:06.131972 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-922cb550-3514-45ea-90d5-40b27583449b tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 404 len: 111 microversion: 2.1 time: 0.092871 Jun 30 17:54:06.137046 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 78/169] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 17:54:06 2022] DELETE /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:54:06.143449 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:06.144233 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] [instance: 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:06.160527 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:06.161073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:06.162261 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:06.163906 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:06.198810 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] HTTP exception thrown: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Request method failure captured: Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd HTTP/1.1 Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveL5PGZ-Oj8ZFsT2oO05WwdtKzk2XiaGHQ7nbzmT9-vO38pGvsTD2VNNWqbU44hyo00kZ6ni9UKoyg6AaKGFAQMimrlO0yUyBD1tWs3ePydL1dyX1gjZY89UHLacl2r1jeGSEpLCNzp4PtVpykOCMV4fxyhzzqUTQNRnukxN0oHeaDw Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 66e3ea2346c743ef96f525d34c031848 Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:54:06.206885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/66e3ea2346c743ef96f525d34c031848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_66e3ea2346c743ef96f525d34c031848"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66e3ea2346c743ef96f525d34c031848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/66e3ea2346c743ef96f525d34c031848"}]}] Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 66e3ea2346c743ef96f525d34c031848 Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-DeleteServersTestJSON-1676900660 Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-DeleteServersTestJSON-1676900660-project Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 52a3c04395c64202b10451c270bac9c5 Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-DeleteServersTestJSON-1676900660-project Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.208117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd'} Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:54:06.208952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. Jun 30 17:54:06.210032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:54:06.212282 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] Returning 404 to user: Instance 26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:54:06.213757 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-54a13489-8c79-4ae6-afff-47cee6646ab5 tempest-DeleteServersTestJSON-1676900660 tempest-DeleteServersTestJSON-1676900660-project] 10.222.0.16 "GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd" status: 404 len: 111 microversion: 2.1 time: 0.071568 Jun 30 17:54:06.218878 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 92/170] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:06 2022] GET /compute/v2.1/servers/26d3bd96-ef2d-4b6d-81ee-5bf81b4407cd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:54:23.273909 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=9 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:23.280389 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=4 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:23.522748 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-142005943", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:54:23.636073 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] validate_networks() for [('9e2484d5-a4ce-47c2-9827-ec8026b3df66', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 17:54:24.346535 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 17:54:24.347141 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 17:54:24.348013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 17:54:24.348632 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 17:54:24.349071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 17:54:24.367603 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:24.368245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:24.369310 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:24.372570 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:24.424941 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Getting quotas for project 1dc70bdf33a44324a55e8a894a7340ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:54:24.429749 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Getting quotas for user e031883951b8486581e198cf6c9705b8 and project 1dc70bdf33a44324a55e8a894a7340ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:54:24.446497 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 17:54:24.450174 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: e96946d3-6552-4429-8bce-a4d9f8ac9318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 17:54:24.543339 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5b5db536-da44-4bed-97c6-69af15e757ba tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.274311 Jun 30 17:54:24.551817 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 79/171] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 17:54:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 17:54:24.555432 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bd894a7f-80e8-45e4-9598-52776cf2149f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:24.556035 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-bd894a7f-80e8-45e4-9598-52776cf2149f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: e96946d3-6552-4429-8bce-a4d9f8ac9318] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:24.564700 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:24.595618 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:24.691167 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bd894a7f-80e8-45e4-9598-52776cf2149f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:24.704869 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-bd894a7f-80e8-45e4-9598-52776cf2149f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318" status: 200 len: 1221 microversion: 2.1 time: 0.146763 Jun 30 17:54:24.707728 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 93/172] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:24 2022] GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318 => generated 1221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:24.957303 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1447637583", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:54:25.057061 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] validate_networks() for [('9e2484d5-a4ce-47c2-9827-ec8026b3df66', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 17:54:25.752469 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 17:54:25.753097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 17:54:25.753395 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 17:54:25.755832 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 17:54:25.759724 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 17:54:25.775171 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:25.775782 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:25.776725 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:25.777169 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:25.819898 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Getting quotas for project 1dc70bdf33a44324a55e8a894a7340ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:54:25.828383 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Getting quotas for user e031883951b8486581e198cf6c9705b8 and project 1dc70bdf33a44324a55e8a894a7340ee. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:54:25.853286 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 17:54:25.872122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 17:54:26.085425 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2b7d20f0-c023-431e-9b03-a55f2bab37ed tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.134305 Jun 30 17:54:26.087174 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 80/173] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 17:54:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 17:54:26.106558 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ac370030-a989-46f6-9c61-7615f2327743 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:26.108242 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ac370030-a989-46f6-9c61-7615f2327743 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:26.243386 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-ac370030-a989-46f6-9c61-7615f2327743 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:26.251948 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ac370030-a989-46f6-9c61-7615f2327743 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1222 microversion: 2.1 time: 0.150708 Jun 30 17:54:26.256577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 94/174] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:26 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:27.274358 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a9874ae4-0e9c-4a2a-83fc-5413ca16fe2c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:27.275634 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a9874ae4-0e9c-4a2a-83fc-5413ca16fe2c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:27.284926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a9874ae4-0e9c-4a2a-83fc-5413ca16fe2c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:27.286768 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a9874ae4-0e9c-4a2a-83fc-5413ca16fe2c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:27.288001 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a9874ae4-0e9c-4a2a-83fc-5413ca16fe2c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:27.290371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a9874ae4-0e9c-4a2a-83fc-5413ca16fe2c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:27.640509 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a9874ae4-0e9c-4a2a-83fc-5413ca16fe2c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:27.659236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a9874ae4-0e9c-4a2a-83fc-5413ca16fe2c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1218 microversion: 2.1 time: 0.389283 Jun 30 17:54:27.661067 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 81/175] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:27 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1218 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:54:28.680571 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e9a364fc-2c89-45ab-950f-6079075b3506 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:28.682447 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e9a364fc-2c89-45ab-950f-6079075b3506 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:28.696578 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e9a364fc-2c89-45ab-950f-6079075b3506 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:28.697941 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e9a364fc-2c89-45ab-950f-6079075b3506 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:28.700816 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e9a364fc-2c89-45ab-950f-6079075b3506 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:28.702644 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e9a364fc-2c89-45ab-950f-6079075b3506 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:28.873415 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e9a364fc-2c89-45ab-950f-6079075b3506 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:28.889252 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e9a364fc-2c89-45ab-950f-6079075b3506 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1280 microversion: 2.1 time: 0.214017 Jun 30 17:54:28.904134 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 95/176] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:28 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1280 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:29.911620 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ca1995be-ce71-4bee-9e33-55d3c688df49 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:29.912226 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ca1995be-ce71-4bee-9e33-55d3c688df49 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:29.927287 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca1995be-ce71-4bee-9e33-55d3c688df49 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:29.928160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca1995be-ce71-4bee-9e33-55d3c688df49 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:29.931738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca1995be-ce71-4bee-9e33-55d3c688df49 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:29.932509 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca1995be-ce71-4bee-9e33-55d3c688df49 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:30.157648 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ca1995be-ce71-4bee-9e33-55d3c688df49 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:30.171873 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ca1995be-ce71-4bee-9e33-55d3c688df49 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1280 microversion: 2.1 time: 0.265131 Jun 30 17:54:30.191493 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 82/177] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:29 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1280 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:31.208269 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-339b03a0-ce1b-4616-b42e-b60c46edbf26 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:31.209463 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-339b03a0-ce1b-4616-b42e-b60c46edbf26 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:31.223569 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-339b03a0-ce1b-4616-b42e-b60c46edbf26 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:31.225263 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-339b03a0-ce1b-4616-b42e-b60c46edbf26 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:31.229775 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-339b03a0-ce1b-4616-b42e-b60c46edbf26 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:31.233835 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-339b03a0-ce1b-4616-b42e-b60c46edbf26 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:31.515408 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-339b03a0-ce1b-4616-b42e-b60c46edbf26 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:31.533001 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-339b03a0-ce1b-4616-b42e-b60c46edbf26 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.328974 Jun 30 17:54:31.537007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 96/178] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:31 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:32.095446 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-38ca3c02-5bce-4990-bb64-65dd66410b7f req-769549c2-c66e-43f6-9f08-cfd1f36ac7bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e96946d3-6552-4429-8bce-a4d9f8ac9318", "tag": "3a07ee47-30bf-4df5-9e2b-7714125bc765"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:54:32.115576 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-38ca3c02-5bce-4990-bb64-65dd66410b7f req-769549c2-c66e-43f6-9f08-cfd1f36ac7bb service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:32.116029 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-38ca3c02-5bce-4990-bb64-65dd66410b7f req-769549c2-c66e-43f6-9f08-cfd1f36ac7bb service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:32.142368 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-38ca3c02-5bce-4990-bb64-65dd66410b7f req-769549c2-c66e-43f6-9f08-cfd1f36ac7bb service nova] Creating event network-changed:3a07ee47-30bf-4df5-9e2b-7714125bc765 for instance e96946d3-6552-4429-8bce-a4d9f8ac9318 on hv-cinder-81268 Jun 30 17:54:32.158276 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-38ca3c02-5bce-4990-bb64-65dd66410b7f req-769549c2-c66e-43f6-9f08-cfd1f36ac7bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065065 Jun 30 17:54:32.158990 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 83/179] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:54:32.554801 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c4a11895-95c6-4695-bafe-bc3da5ea82f8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:32.555564 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c4a11895-95c6-4695-bafe-bc3da5ea82f8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:32.573618 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c4a11895-95c6-4695-bafe-bc3da5ea82f8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:32.574090 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c4a11895-95c6-4695-bafe-bc3da5ea82f8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:32.577982 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c4a11895-95c6-4695-bafe-bc3da5ea82f8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:32.578898 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c4a11895-95c6-4695-bafe-bc3da5ea82f8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:32.761181 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c4a11895-95c6-4695-bafe-bc3da5ea82f8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:32.773822 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c4a11895-95c6-4695-bafe-bc3da5ea82f8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.223918 Jun 30 17:54:32.774907 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 97/180] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:32 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:33.793107 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-de4d21db-0491-44a7-8d55-86ae1fcb3371 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:33.794759 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-de4d21db-0491-44a7-8d55-86ae1fcb3371 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:33.801395 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-de4d21db-0491-44a7-8d55-86ae1fcb3371 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:33.804543 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-de4d21db-0491-44a7-8d55-86ae1fcb3371 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:33.806410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-de4d21db-0491-44a7-8d55-86ae1fcb3371 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:33.807039 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-de4d21db-0491-44a7-8d55-86ae1fcb3371 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:33.966591 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-de4d21db-0491-44a7-8d55-86ae1fcb3371 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:33.974649 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-de4d21db-0491-44a7-8d55-86ae1fcb3371 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.186498 Jun 30 17:54:33.975220 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 84/181] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:33 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:34.194737 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-38130a67-cea8-40c4-a189-18f257cb4df6 req-943a50f4-16cb-4b27-b260-7780a7e7e1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6809d58d-8edd-4bc0-b068-4a278f6fc37d", "tag": "3d94c499-5b2c-4ec8-bc2c-db39e0936d8b"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:54:34.209038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-38130a67-cea8-40c4-a189-18f257cb4df6 req-943a50f4-16cb-4b27-b260-7780a7e7e1c3 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:34.213419 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-38130a67-cea8-40c4-a189-18f257cb4df6 req-943a50f4-16cb-4b27-b260-7780a7e7e1c3 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:34.232379 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-38130a67-cea8-40c4-a189-18f257cb4df6 req-943a50f4-16cb-4b27-b260-7780a7e7e1c3 service nova] Creating event network-changed:3d94c499-5b2c-4ec8-bc2c-db39e0936d8b for instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d on hv-cinder-81268 Jun 30 17:54:34.241509 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-38130a67-cea8-40c4-a189-18f257cb4df6 req-943a50f4-16cb-4b27-b260-7780a7e7e1c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050017 Jun 30 17:54:34.242134 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 98/182] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:54:34.994647 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-99d54d14-118b-4896-bd1e-d537d186a629 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:34.995325 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-99d54d14-118b-4896-bd1e-d537d186a629 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:35.005878 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99d54d14-118b-4896-bd1e-d537d186a629 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:35.006419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99d54d14-118b-4896-bd1e-d537d186a629 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:35.007262 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99d54d14-118b-4896-bd1e-d537d186a629 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:35.007762 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-99d54d14-118b-4896-bd1e-d537d186a629 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:35.176930 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-99d54d14-118b-4896-bd1e-d537d186a629 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:35.185508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-99d54d14-118b-4896-bd1e-d537d186a629 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.197844 Jun 30 17:54:35.186088 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 85/183] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:34 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:36.203564 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-934e5db0-7e48-43b1-98d3-fd812d7eb656 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:36.204261 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-934e5db0-7e48-43b1-98d3-fd812d7eb656 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:36.210663 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-934e5db0-7e48-43b1-98d3-fd812d7eb656 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:36.211109 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-934e5db0-7e48-43b1-98d3-fd812d7eb656 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:36.211867 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-934e5db0-7e48-43b1-98d3-fd812d7eb656 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:36.212292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-934e5db0-7e48-43b1-98d3-fd812d7eb656 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:36.257806 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=4 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:36.356795 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-934e5db0-7e48-43b1-98d3-fd812d7eb656 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:36.379751 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-934e5db0-7e48-43b1-98d3-fd812d7eb656 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.180248 Jun 30 17:54:36.382572 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 99/184] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:36 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:36.633070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-782edd0d-8433-4a1b-be19-c745a64acefc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Action: 'create', calling method: .version_select at 0x7f8f3c3e2c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-946586470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd0GJFECgOEs2vnYNYGevuSD0a7ZoMqHkcTMgbmWejF8JGPzNSOhy+FWayWPh8weLPgHZz6SPpqXUNVniZxyQGdRbZrZW1Wp7QgfFm2tWP+b6+GTdeoBEEDwcizMpUXKw=="}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:54:36.637200 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=4 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:36.637862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=12 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:36.650723 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-782edd0d-8433-4a1b-be19-c745a64acefc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Getting quotas for project 6a4beb48dfc14400b1872c2930ea1e11. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:54:36.654784 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-782edd0d-8433-4a1b-be19-c745a64acefc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Getting quotas for user 0021d731c3344934b33b5ed2b35284be and project 6a4beb48dfc14400b1872c2930ea1e11. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:54:36.677766 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-782edd0d-8433-4a1b-be19-c745a64acefc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048470 Jun 30 17:54:36.678437 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 86/185] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 17:54:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:54:36.833833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1380996553", "imageRef": "1e62f22e-d9b2-40d0-b0ec-7b6d0c79f3cd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-946586470", "networks": [{"uuid": "c207555b-ac1b-4ccd-bc64-e2cfb085bd17"}]}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:54:36.885479 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.network.neutron [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] validate_networks() for [('c207555b-ac1b-4ccd-bc64-e2cfb085bd17', None, None, None, None, None)] {{(pid=129370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 17:54:37.252417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Flavor limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 17:54:37.253013 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Image limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 17:54:37.253335 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Flavor pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 17:54:37.253745 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Image pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 17:54:37.254149 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 17:54:37.263637 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:37.264085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:37.264875 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:37.265310 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:37.283281 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Getting quotas for project 6a4beb48dfc14400b1872c2930ea1e11. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:54:37.287232 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Getting quotas for user 0021d731c3344934b33b5ed2b35284be and project 6a4beb48dfc14400b1872c2930ea1e11. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:54:37.298116 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Going to run 1 instances... {{(pid=129370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 17:54:37.300306 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e62f22e-d9b2-40d0-b0ec-7b6d0c79f3cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 17:54:37.346465 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-695a4721-a6e4-477f-b2f4-1daaa06b435b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516379 Jun 30 17:54:37.347111 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 100/186] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 17:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 17:54:37.356782 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d5077841-fc02-4350-9bfa-df3213f92d05 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:37.357393 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d5077841-fc02-4350-9bfa-df3213f92d05 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:37.400199 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3220fbe3-c412-4b8a-9414-67a0a68a9653 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:37.400862 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3220fbe3-c412-4b8a-9414-67a0a68a9653 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:37.412181 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d5077841-fc02-4350-9bfa-df3213f92d05 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:37.419790 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3220fbe3-c412-4b8a-9414-67a0a68a9653 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:37.420237 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3220fbe3-c412-4b8a-9414-67a0a68a9653 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:37.420492 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d5077841-fc02-4350-9bfa-df3213f92d05 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1258 microversion: 2.1 time: 0.067527 Jun 30 17:54:37.421255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3220fbe3-c412-4b8a-9414-67a0a68a9653 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:37.421385 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 87/187] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:37 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:37.426840 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3220fbe3-c412-4b8a-9414-67a0a68a9653 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:37.563329 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3220fbe3-c412-4b8a-9414-67a0a68a9653 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:37.570804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3220fbe3-c412-4b8a-9414-67a0a68a9653 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.174279 Jun 30 17:54:37.571699 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 101/188] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:37 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:54:38.437120 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-864aa9db-8f49-4619-986d-0e80eec25ccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:38.438357 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-864aa9db-8f49-4619-986d-0e80eec25ccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:38.444738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-864aa9db-8f49-4619-986d-0e80eec25ccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:38.445176 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-864aa9db-8f49-4619-986d-0e80eec25ccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:38.445919 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-864aa9db-8f49-4619-986d-0e80eec25ccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:38.446371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-864aa9db-8f49-4619-986d-0e80eec25ccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:38.510956 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-864aa9db-8f49-4619-986d-0e80eec25ccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:38.518264 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-864aa9db-8f49-4619-986d-0e80eec25ccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1262 microversion: 2.1 time: 0.085012 Jun 30 17:54:38.518859 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 88/189] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:38 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:38.588618 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-943e6fae-65e7-4dff-9ab7-d7811b6a7ad7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:38.589218 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-943e6fae-65e7-4dff-9ab7-d7811b6a7ad7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:38.595414 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-943e6fae-65e7-4dff-9ab7-d7811b6a7ad7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:38.595855 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-943e6fae-65e7-4dff-9ab7-d7811b6a7ad7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:38.596628 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-943e6fae-65e7-4dff-9ab7-d7811b6a7ad7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:38.597052 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-943e6fae-65e7-4dff-9ab7-d7811b6a7ad7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:38.724018 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-943e6fae-65e7-4dff-9ab7-d7811b6a7ad7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:38.731430 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-943e6fae-65e7-4dff-9ab7-d7811b6a7ad7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.146717 Jun 30 17:54:38.731991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 102/190] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:38 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:39.536999 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-65357e68-fdf7-4d17-95c4-065945c9a9d1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:39.537621 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-65357e68-fdf7-4d17-95c4-065945c9a9d1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:39.544091 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-65357e68-fdf7-4d17-95c4-065945c9a9d1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:39.544540 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-65357e68-fdf7-4d17-95c4-065945c9a9d1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:39.545297 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-65357e68-fdf7-4d17-95c4-065945c9a9d1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:39.545733 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-65357e68-fdf7-4d17-95c4-065945c9a9d1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:39.616735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-65357e68-fdf7-4d17-95c4-065945c9a9d1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:39.624086 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-65357e68-fdf7-4d17-95c4-065945c9a9d1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1262 microversion: 2.1 time: 0.093219 Jun 30 17:54:39.624640 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 89/191] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:39 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:39.748870 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-42b66c5e-2325-47dc-8ebd-564e8d43d531 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:39.749470 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-42b66c5e-2325-47dc-8ebd-564e8d43d531 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:39.756263 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42b66c5e-2325-47dc-8ebd-564e8d43d531 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:39.756703 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42b66c5e-2325-47dc-8ebd-564e8d43d531 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:39.757437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42b66c5e-2325-47dc-8ebd-564e8d43d531 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:39.757859 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42b66c5e-2325-47dc-8ebd-564e8d43d531 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:39.885773 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-42b66c5e-2325-47dc-8ebd-564e8d43d531 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:39.894025 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-42b66c5e-2325-47dc-8ebd-564e8d43d531 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.148702 Jun 30 17:54:39.894619 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 103/192] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:39 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:40.641553 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-86ae7fc2-de8c-4934-9576-f1af491a645e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:40.642187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-86ae7fc2-de8c-4934-9576-f1af491a645e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:40.648616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86ae7fc2-de8c-4934-9576-f1af491a645e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:40.649062 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86ae7fc2-de8c-4934-9576-f1af491a645e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:40.649804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86ae7fc2-de8c-4934-9576-f1af491a645e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:40.650230 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86ae7fc2-de8c-4934-9576-f1af491a645e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:40.715919 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-86ae7fc2-de8c-4934-9576-f1af491a645e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:40.723581 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-86ae7fc2-de8c-4934-9576-f1af491a645e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1262 microversion: 2.1 time: 0.086490 Jun 30 17:54:40.724142 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 90/193] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:40 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:40.910793 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c90b4ce8-6bbf-4d7c-87c4-e97f4334a12d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:40.911316 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c90b4ce8-6bbf-4d7c-87c4-e97f4334a12d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:40.917297 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c90b4ce8-6bbf-4d7c-87c4-e97f4334a12d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:40.917735 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c90b4ce8-6bbf-4d7c-87c4-e97f4334a12d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:40.918497 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c90b4ce8-6bbf-4d7c-87c4-e97f4334a12d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:40.918923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c90b4ce8-6bbf-4d7c-87c4-e97f4334a12d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:41.044252 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c90b4ce8-6bbf-4d7c-87c4-e97f4334a12d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:41.052132 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c90b4ce8-6bbf-4d7c-87c4-e97f4334a12d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.145241 Jun 30 17:54:41.052693 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 104/194] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:40 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:41.739676 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4e0a6c3c-a8fb-4b66-bae3-da9f47b4bf29 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:41.740288 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4e0a6c3c-a8fb-4b66-bae3-da9f47b4bf29 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:41.746816 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e0a6c3c-a8fb-4b66-bae3-da9f47b4bf29 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:41.747266 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e0a6c3c-a8fb-4b66-bae3-da9f47b4bf29 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:41.748024 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e0a6c3c-a8fb-4b66-bae3-da9f47b4bf29 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:41.748475 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e0a6c3c-a8fb-4b66-bae3-da9f47b4bf29 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:41.809290 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4e0a6c3c-a8fb-4b66-bae3-da9f47b4bf29 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:41.817204 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4e0a6c3c-a8fb-4b66-bae3-da9f47b4bf29 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1262 microversion: 2.1 time: 0.081452 Jun 30 17:54:41.817836 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 91/195] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:41 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:54:42.068666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-56b0c640-2cab-4f74-80f6-d07874ae1e97 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:42.069287 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-56b0c640-2cab-4f74-80f6-d07874ae1e97 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:42.075661 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-56b0c640-2cab-4f74-80f6-d07874ae1e97 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:42.076084 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-56b0c640-2cab-4f74-80f6-d07874ae1e97 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:42.076828 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-56b0c640-2cab-4f74-80f6-d07874ae1e97 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:42.077252 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-56b0c640-2cab-4f74-80f6-d07874ae1e97 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:42.208848 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-56b0c640-2cab-4f74-80f6-d07874ae1e97 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:42.216252 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-56b0c640-2cab-4f74-80f6-d07874ae1e97 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.151319 Jun 30 17:54:42.216833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 105/196] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:42 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:42.834639 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-32fdedd3-0aef-4e57-abea-da3ce8baea01 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:42.835358 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-32fdedd3-0aef-4e57-abea-da3ce8baea01 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:42.841784 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-32fdedd3-0aef-4e57-abea-da3ce8baea01 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:42.842254 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-32fdedd3-0aef-4e57-abea-da3ce8baea01 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:42.843036 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-32fdedd3-0aef-4e57-abea-da3ce8baea01 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:42.843465 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-32fdedd3-0aef-4e57-abea-da3ce8baea01 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:42.905517 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-32fdedd3-0aef-4e57-abea-da3ce8baea01 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:42.913486 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-32fdedd3-0aef-4e57-abea-da3ce8baea01 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1262 microversion: 2.1 time: 0.082668 Jun 30 17:54:42.914369 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 92/197] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:42 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:43.232852 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-299a562f-9a44-46b5-addf-71c6c4edf3d0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:43.234731 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-299a562f-9a44-46b5-addf-71c6c4edf3d0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:43.241231 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-299a562f-9a44-46b5-addf-71c6c4edf3d0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:43.241751 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-299a562f-9a44-46b5-addf-71c6c4edf3d0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:43.242681 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-299a562f-9a44-46b5-addf-71c6c4edf3d0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:43.243118 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-299a562f-9a44-46b5-addf-71c6c4edf3d0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:43.383381 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-299a562f-9a44-46b5-addf-71c6c4edf3d0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:43.391451 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-299a562f-9a44-46b5-addf-71c6c4edf3d0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.162222 Jun 30 17:54:43.392078 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 106/198] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:43 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:43.934691 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4e398eb0-ce83-4f31-ac49-c5d714659dea tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:43.935311 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4e398eb0-ce83-4f31-ac49-c5d714659dea tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:43.942354 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e398eb0-ce83-4f31-ac49-c5d714659dea tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:43.942821 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e398eb0-ce83-4f31-ac49-c5d714659dea tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:43.943580 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e398eb0-ce83-4f31-ac49-c5d714659dea tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:43.953528 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e398eb0-ce83-4f31-ac49-c5d714659dea tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:44.043446 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4e398eb0-ce83-4f31-ac49-c5d714659dea tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:44.051415 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4e398eb0-ce83-4f31-ac49-c5d714659dea tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1318 microversion: 2.1 time: 0.124501 Jun 30 17:54:44.052004 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 93/199] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:43 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1318 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:44.408698 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a048869e-00d5-4b96-afdd-a9cf45e7ef9d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:44.409299 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a048869e-00d5-4b96-afdd-a9cf45e7ef9d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:44.415561 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a048869e-00d5-4b96-afdd-a9cf45e7ef9d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:44.416001 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a048869e-00d5-4b96-afdd-a9cf45e7ef9d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:44.416750 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a048869e-00d5-4b96-afdd-a9cf45e7ef9d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:44.417172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a048869e-00d5-4b96-afdd-a9cf45e7ef9d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:44.543498 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-a048869e-00d5-4b96-afdd-a9cf45e7ef9d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:44.551305 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a048869e-00d5-4b96-afdd-a9cf45e7ef9d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.147080 Jun 30 17:54:44.551871 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 107/200] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:44 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:45.068089 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d0efbdf2-51e3-4c0f-8a8b-7430fb41cde2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:45.068704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d0efbdf2-51e3-4c0f-8a8b-7430fb41cde2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:45.075473 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d0efbdf2-51e3-4c0f-8a8b-7430fb41cde2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:45.075919 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d0efbdf2-51e3-4c0f-8a8b-7430fb41cde2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:45.076714 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d0efbdf2-51e3-4c0f-8a8b-7430fb41cde2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:45.077149 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d0efbdf2-51e3-4c0f-8a8b-7430fb41cde2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:45.138142 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d0efbdf2-51e3-4c0f-8a8b-7430fb41cde2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:45.146511 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d0efbdf2-51e3-4c0f-8a8b-7430fb41cde2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1328 microversion: 2.1 time: 0.082158 Jun 30 17:54:45.147138 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 94/201] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:45 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1328 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:45.568893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ab14735d-42ec-45cf-a76b-866be8a0f76d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:45.569519 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ab14735d-42ec-45cf-a76b-866be8a0f76d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:45.576124 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab14735d-42ec-45cf-a76b-866be8a0f76d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:45.576616 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab14735d-42ec-45cf-a76b-866be8a0f76d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:45.577503 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab14735d-42ec-45cf-a76b-866be8a0f76d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:45.578628 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ab14735d-42ec-45cf-a76b-866be8a0f76d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:45.709924 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-ab14735d-42ec-45cf-a76b-866be8a0f76d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:45.717450 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ab14735d-42ec-45cf-a76b-866be8a0f76d tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.152382 Jun 30 17:54:45.718005 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 108/202] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:45 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:46.162893 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-9a93872e-7209-4f56-a6a2-f01ab7fcc517 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:46.163528 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-9a93872e-7209-4f56-a6a2-f01ab7fcc517 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:46.169713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9a93872e-7209-4f56-a6a2-f01ab7fcc517 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:46.170157 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9a93872e-7209-4f56-a6a2-f01ab7fcc517 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:46.170948 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9a93872e-7209-4f56-a6a2-f01ab7fcc517 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:46.171381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9a93872e-7209-4f56-a6a2-f01ab7fcc517 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:46.231043 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-9a93872e-7209-4f56-a6a2-f01ab7fcc517 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:46.238976 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-9a93872e-7209-4f56-a6a2-f01ab7fcc517 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1328 microversion: 2.1 time: 0.080043 Jun 30 17:54:46.239535 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 95/203] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:46 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1328 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:46.733860 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e3329d1b-dd51-49bd-92de-5e30d88f3946 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:46.734522 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e3329d1b-dd51-49bd-92de-5e30d88f3946 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:46.740478 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e3329d1b-dd51-49bd-92de-5e30d88f3946 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:46.740919 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e3329d1b-dd51-49bd-92de-5e30d88f3946 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:46.741692 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e3329d1b-dd51-49bd-92de-5e30d88f3946 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:46.742121 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e3329d1b-dd51-49bd-92de-5e30d88f3946 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:46.870900 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e3329d1b-dd51-49bd-92de-5e30d88f3946 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:46.878224 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e3329d1b-dd51-49bd-92de-5e30d88f3946 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.148080 Jun 30 17:54:46.878807 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 109/204] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:46 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:47.256161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1724cf57-1cf4-4e39-aab0-1bb79a8eefbe tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:47.256690 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1724cf57-1cf4-4e39-aab0-1bb79a8eefbe tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:47.263170 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1724cf57-1cf4-4e39-aab0-1bb79a8eefbe tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:47.263617 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1724cf57-1cf4-4e39-aab0-1bb79a8eefbe tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:47.264373 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1724cf57-1cf4-4e39-aab0-1bb79a8eefbe tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:47.264807 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1724cf57-1cf4-4e39-aab0-1bb79a8eefbe tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:47.329655 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1724cf57-1cf4-4e39-aab0-1bb79a8eefbe tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:47.337229 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1724cf57-1cf4-4e39-aab0-1bb79a8eefbe tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1328 microversion: 2.1 time: 0.085488 Jun 30 17:54:47.337796 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 96/205] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:47 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1328 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:47.895841 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1b311f73-127a-434e-8e5a-e2cede578a1b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:47.896377 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1b311f73-127a-434e-8e5a-e2cede578a1b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:47.898223 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:47.899005 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=6 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:47.905054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1b311f73-127a-434e-8e5a-e2cede578a1b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:47.905497 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1b311f73-127a-434e-8e5a-e2cede578a1b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:47.906319 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1b311f73-127a-434e-8e5a-e2cede578a1b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:47.907109 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1b311f73-127a-434e-8e5a-e2cede578a1b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:48.042283 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1b311f73-127a-434e-8e5a-e2cede578a1b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:48.049675 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1b311f73-127a-434e-8e5a-e2cede578a1b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.157835 Jun 30 17:54:48.050232 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 110/206] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:47 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:48.354409 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1dd253b4-b7ab-4e3f-a0b7-351ae4dcf871 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:48.355002 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1dd253b4-b7ab-4e3f-a0b7-351ae4dcf871 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:48.356811 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=6 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:48.363046 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1dd253b4-b7ab-4e3f-a0b7-351ae4dcf871 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:48.363491 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1dd253b4-b7ab-4e3f-a0b7-351ae4dcf871 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:48.364235 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1dd253b4-b7ab-4e3f-a0b7-351ae4dcf871 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:48.364661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1dd253b4-b7ab-4e3f-a0b7-351ae4dcf871 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:48.424253 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1dd253b4-b7ab-4e3f-a0b7-351ae4dcf871 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:48.431780 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1dd253b4-b7ab-4e3f-a0b7-351ae4dcf871 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1328 microversion: 2.1 time: 0.081178 Jun 30 17:54:48.432409 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 97/207] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:48 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1328 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:49.066746 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9da2d2c0-4d6d-4bc3-a0a8-e37746f9dfc0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:49.067342 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-9da2d2c0-4d6d-4bc3-a0a8-e37746f9dfc0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:49.073614 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9da2d2c0-4d6d-4bc3-a0a8-e37746f9dfc0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:49.074054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9da2d2c0-4d6d-4bc3-a0a8-e37746f9dfc0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:49.074823 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9da2d2c0-4d6d-4bc3-a0a8-e37746f9dfc0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:49.075251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9da2d2c0-4d6d-4bc3-a0a8-e37746f9dfc0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:49.203132 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-9da2d2c0-4d6d-4bc3-a0a8-e37746f9dfc0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:49.211054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-9da2d2c0-4d6d-4bc3-a0a8-e37746f9dfc0 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.148542 Jun 30 17:54:49.211759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 111/208] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:49 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:49.449066 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-73e74ebd-c2c3-4688-9f1f-63484cd8121d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:49.449678 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-73e74ebd-c2c3-4688-9f1f-63484cd8121d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:49.456329 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-73e74ebd-c2c3-4688-9f1f-63484cd8121d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:49.456780 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-73e74ebd-c2c3-4688-9f1f-63484cd8121d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:49.457548 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-73e74ebd-c2c3-4688-9f1f-63484cd8121d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:49.457986 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-73e74ebd-c2c3-4688-9f1f-63484cd8121d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:49.517207 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-73e74ebd-c2c3-4688-9f1f-63484cd8121d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:49.524963 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-73e74ebd-c2c3-4688-9f1f-63484cd8121d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1328 microversion: 2.1 time: 0.079971 Jun 30 17:54:49.525586 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 98/209] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:49 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1328 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:50.226886 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e212526f-31a1-45d0-a323-2430449fe2d8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:50.227487 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e212526f-31a1-45d0-a323-2430449fe2d8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:50.233424 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e212526f-31a1-45d0-a323-2430449fe2d8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:50.234527 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e212526f-31a1-45d0-a323-2430449fe2d8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:50.235287 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e212526f-31a1-45d0-a323-2430449fe2d8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:50.235711 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e212526f-31a1-45d0-a323-2430449fe2d8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:50.365940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e212526f-31a1-45d0-a323-2430449fe2d8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:50.369510 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=100 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:50.374179 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e212526f-31a1-45d0-a323-2430449fe2d8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.151054 Jun 30 17:54:50.374791 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 112/210] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:50 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:50.542155 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-38b575c7-87d8-4c2e-8c07-f67c70e4fc95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:50.542802 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-38b575c7-87d8-4c2e-8c07-f67c70e4fc95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:50.549399 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-38b575c7-87d8-4c2e-8c07-f67c70e4fc95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:50.549851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-38b575c7-87d8-4c2e-8c07-f67c70e4fc95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:50.550848 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-38b575c7-87d8-4c2e-8c07-f67c70e4fc95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:50.551287 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-38b575c7-87d8-4c2e-8c07-f67c70e4fc95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:50.570199 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=100 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:50.615696 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-38b575c7-87d8-4c2e-8c07-f67c70e4fc95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:50.623286 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-38b575c7-87d8-4c2e-8c07-f67c70e4fc95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1328 microversion: 2.1 time: 0.084902 Jun 30 17:54:50.624010 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 99/211] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:50 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1328 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:50.625529 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-b14dc662-b89c-459d-87f6-efe4ba611167 req-cafe8e3a-36b6-47fd-8d13-28b725a8eed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96946d3-6552-4429-8bce-a4d9f8ac9318", "name": "network-vif-plugged", "status": "completed", "tag": "3a07ee47-30bf-4df5-9e2b-7714125bc765"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:54:50.635011 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-b14dc662-b89c-459d-87f6-efe4ba611167 req-cafe8e3a-36b6-47fd-8d13-28b725a8eed6 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:50.635447 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-b14dc662-b89c-459d-87f6-efe4ba611167 req-cafe8e3a-36b6-47fd-8d13-28b725a8eed6 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:50.650249 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-b14dc662-b89c-459d-87f6-efe4ba611167 req-cafe8e3a-36b6-47fd-8d13-28b725a8eed6 service nova] Creating event network-vif-plugged:3a07ee47-30bf-4df5-9e2b-7714125bc765 for instance e96946d3-6552-4429-8bce-a4d9f8ac9318 on hv-cinder-81268 Jun 30 17:54:50.655726 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-b14dc662-b89c-459d-87f6-efe4ba611167 req-cafe8e3a-36b6-47fd-8d13-28b725a8eed6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034100 Jun 30 17:54:50.656820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 113/212] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:54:51.390423 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3c39544b-34d2-4585-8469-ac91ad1a1b73 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:51.390966 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3c39544b-34d2-4585-8469-ac91ad1a1b73 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:51.396988 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3c39544b-34d2-4585-8469-ac91ad1a1b73 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:51.397433 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3c39544b-34d2-4585-8469-ac91ad1a1b73 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:51.398187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3c39544b-34d2-4585-8469-ac91ad1a1b73 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:51.398647 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3c39544b-34d2-4585-8469-ac91ad1a1b73 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:51.528335 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3c39544b-34d2-4585-8469-ac91ad1a1b73 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:51.536284 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3c39544b-34d2-4585-8469-ac91ad1a1b73 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.149795 Jun 30 17:54:51.536848 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 100/213] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:51 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:51.640552 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-762aae87-8fca-4235-9eee-cfc3a2d7c136 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:51.641157 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-762aae87-8fca-4235-9eee-cfc3a2d7c136 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:51.647447 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-762aae87-8fca-4235-9eee-cfc3a2d7c136 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:51.647873 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-762aae87-8fca-4235-9eee-cfc3a2d7c136 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:51.648620 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-762aae87-8fca-4235-9eee-cfc3a2d7c136 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:51.649237 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-762aae87-8fca-4235-9eee-cfc3a2d7c136 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:51.712053 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-762aae87-8fca-4235-9eee-cfc3a2d7c136 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:51.719310 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-762aae87-8fca-4235-9eee-cfc3a2d7c136 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1328 microversion: 2.1 time: 0.082995 Jun 30 17:54:51.720424 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 114/214] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:51 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1328 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:52.553547 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-fbe649df-7cc0-48dd-974f-68effd66e738 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:52.554814 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-fbe649df-7cc0-48dd-974f-68effd66e738 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:52.563011 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fbe649df-7cc0-48dd-974f-68effd66e738 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:52.563727 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fbe649df-7cc0-48dd-974f-68effd66e738 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:52.564761 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fbe649df-7cc0-48dd-974f-68effd66e738 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:52.565353 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fbe649df-7cc0-48dd-974f-68effd66e738 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:52.737215 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4e090337-7b19-46df-ad26-aa60be9ee959 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:52.737988 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4e090337-7b19-46df-ad26-aa60be9ee959 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:52.745845 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4e090337-7b19-46df-ad26-aa60be9ee959 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:52.749782 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4e090337-7b19-46df-ad26-aa60be9ee959 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:52.755412 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4e090337-7b19-46df-ad26-aa60be9ee959 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:52.756230 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4e090337-7b19-46df-ad26-aa60be9ee959 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:52.983012 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4e090337-7b19-46df-ad26-aa60be9ee959 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:52.990838 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4e090337-7b19-46df-ad26-aa60be9ee959 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1316 microversion: 2.1 time: 0.257878 Jun 30 17:54:52.995069 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 115/215] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:52 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:53.196492 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-fbe649df-7cc0-48dd-974f-68effd66e738 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:53.206255 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-fbe649df-7cc0-48dd-974f-68effd66e738 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.656467 Jun 30 17:54:53.209066 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 101/216] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:52 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:54.013433 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7f774391-19d7-4bc5-b3f7-6fd0606908d3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:54.013910 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-7f774391-19d7-4bc5-b3f7-6fd0606908d3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:54.020827 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7f774391-19d7-4bc5-b3f7-6fd0606908d3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:54.021937 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7f774391-19d7-4bc5-b3f7-6fd0606908d3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:54.022975 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7f774391-19d7-4bc5-b3f7-6fd0606908d3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:54.023617 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7f774391-19d7-4bc5-b3f7-6fd0606908d3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:54.177471 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-7f774391-19d7-4bc5-b3f7-6fd0606908d3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:54.185030 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-7f774391-19d7-4bc5-b3f7-6fd0606908d3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.176744 Jun 30 17:54:54.186319 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 116/217] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:54 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:54.225598 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-367d4e10-336c-430e-a55b-323a75cdd0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:54.226211 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-367d4e10-336c-430e-a55b-323a75cdd0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:54.228597 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:54.234190 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-367d4e10-336c-430e-a55b-323a75cdd0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:54.234660 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-367d4e10-336c-430e-a55b-323a75cdd0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:54.235412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-367d4e10-336c-430e-a55b-323a75cdd0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:54.235846 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-367d4e10-336c-430e-a55b-323a75cdd0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:54.365318 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-367d4e10-336c-430e-a55b-323a75cdd0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:54.372619 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-367d4e10-336c-430e-a55b-323a75cdd0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.151031 Jun 30 17:54:54.373171 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 102/218] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:54 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:54:55.201455 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bf322233-fa7b-4d70-9549-37fb396b139a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:55.202087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-bf322233-fa7b-4d70-9549-37fb396b139a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:55.204103 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:54:55.209354 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bf322233-fa7b-4d70-9549-37fb396b139a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:55.209799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bf322233-fa7b-4d70-9549-37fb396b139a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:55.210620 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bf322233-fa7b-4d70-9549-37fb396b139a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:55.211045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bf322233-fa7b-4d70-9549-37fb396b139a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:55.346518 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bf322233-fa7b-4d70-9549-37fb396b139a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:55.354462 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-bf322233-fa7b-4d70-9549-37fb396b139a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.157162 Jun 30 17:54:55.355377 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 117/219] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:55 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:55.390462 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-24c0d440-90f9-4662-a834-45f5f6dfbea8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:55.392062 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-24c0d440-90f9-4662-a834-45f5f6dfbea8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:55.400615 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-24c0d440-90f9-4662-a834-45f5f6dfbea8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:55.401077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-24c0d440-90f9-4662-a834-45f5f6dfbea8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:55.401942 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-24c0d440-90f9-4662-a834-45f5f6dfbea8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:55.402917 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-24c0d440-90f9-4662-a834-45f5f6dfbea8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:55.533204 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-f51dddb9-16ee-44f0-9d45-26226d9c2192 req-22b2470a-f190-40b0-b4fd-2c6041abbd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6809d58d-8edd-4bc0-b068-4a278f6fc37d", "name": "network-vif-plugged", "status": "completed", "tag": "3d94c499-5b2c-4ec8-bc2c-db39e0936d8b"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:54:55.546741 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f51dddb9-16ee-44f0-9d45-26226d9c2192 req-22b2470a-f190-40b0-b4fd-2c6041abbd5c service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:55.547529 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f51dddb9-16ee-44f0-9d45-26226d9c2192 req-22b2470a-f190-40b0-b4fd-2c6041abbd5c service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:55.560826 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-f51dddb9-16ee-44f0-9d45-26226d9c2192 req-22b2470a-f190-40b0-b4fd-2c6041abbd5c service nova] Creating event network-vif-plugged:3d94c499-5b2c-4ec8-bc2c-db39e0936d8b for instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d on hv-cinder-81268 Jun 30 17:54:55.575193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-24c0d440-90f9-4662-a834-45f5f6dfbea8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:55.576528 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-f51dddb9-16ee-44f0-9d45-26226d9c2192 req-22b2470a-f190-40b0-b4fd-2c6041abbd5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048080 Jun 30 17:54:55.581744 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 118/220] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:54:55.583121 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-24c0d440-90f9-4662-a834-45f5f6dfbea8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.197606 Jun 30 17:54:55.583693 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 103/221] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:55 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:56.373943 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d1e163dc-7f9d-4636-9f38-0da445bee8c9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:56.375421 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-d1e163dc-7f9d-4636-9f38-0da445bee8c9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:56.383485 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d1e163dc-7f9d-4636-9f38-0da445bee8c9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:56.384329 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d1e163dc-7f9d-4636-9f38-0da445bee8c9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:56.385627 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d1e163dc-7f9d-4636-9f38-0da445bee8c9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:56.386291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d1e163dc-7f9d-4636-9f38-0da445bee8c9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:56.538655 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-d1e163dc-7f9d-4636-9f38-0da445bee8c9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:56.547338 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d1e163dc-7f9d-4636-9f38-0da445bee8c9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.178612 Jun 30 17:54:56.549152 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 119/222] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:56 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:56.599798 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-327da538-dc25-4243-b67b-79d1f6fdc60e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:56.600434 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-327da538-dc25-4243-b67b-79d1f6fdc60e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:56.607212 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-327da538-dc25-4243-b67b-79d1f6fdc60e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:56.607682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-327da538-dc25-4243-b67b-79d1f6fdc60e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:56.608448 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-327da538-dc25-4243-b67b-79d1f6fdc60e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:56.608899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-327da538-dc25-4243-b67b-79d1f6fdc60e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:56.790510 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-327da538-dc25-4243-b67b-79d1f6fdc60e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:56.799272 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-327da538-dc25-4243-b67b-79d1f6fdc60e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.203604 Jun 30 17:54:56.799862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 104/223] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:56 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:57.566187 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-78fbddfe-635c-4512-bcd9-9bc3dd7f642c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:57.566842 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-78fbddfe-635c-4512-bcd9-9bc3dd7f642c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:57.575811 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-78fbddfe-635c-4512-bcd9-9bc3dd7f642c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:57.576261 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-78fbddfe-635c-4512-bcd9-9bc3dd7f642c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:57.577403 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-78fbddfe-635c-4512-bcd9-9bc3dd7f642c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:57.577838 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-78fbddfe-635c-4512-bcd9-9bc3dd7f642c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:57.818875 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-e51ea899-d49f-47e3-9252-3e29e51b4b6e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:57.820324 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-e51ea899-d49f-47e3-9252-3e29e51b4b6e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:57.842426 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e51ea899-d49f-47e3-9252-3e29e51b4b6e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:57.843257 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e51ea899-d49f-47e3-9252-3e29e51b4b6e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:57.844252 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e51ea899-d49f-47e3-9252-3e29e51b4b6e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:57.844968 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e51ea899-d49f-47e3-9252-3e29e51b4b6e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:57.967300 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-78fbddfe-635c-4512-bcd9-9bc3dd7f642c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:57.978920 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-78fbddfe-635c-4512-bcd9-9bc3dd7f642c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.417980 Jun 30 17:54:57.983126 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 120/224] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:57 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:58.127831 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e51ea899-d49f-47e3-9252-3e29e51b4b6e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:58.135908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-e51ea899-d49f-47e3-9252-3e29e51b4b6e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.320961 Jun 30 17:54:58.136482 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 105/225] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:57 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:54:59.022862 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-afc13d32-9579-4df1-83a0-89d6d14e66f3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:59.022862 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-afc13d32-9579-4df1-83a0-89d6d14e66f3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:59.027463 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-afc13d32-9579-4df1-83a0-89d6d14e66f3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:59.028151 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-afc13d32-9579-4df1-83a0-89d6d14e66f3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:59.029148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-afc13d32-9579-4df1-83a0-89d6d14e66f3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:59.030323 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-afc13d32-9579-4df1-83a0-89d6d14e66f3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:59.155285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4f062dd7-ce33-48aa-a91a-d18f716818cf tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:54:59.155285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4f062dd7-ce33-48aa-a91a-d18f716818cf tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:54:59.160785 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4f062dd7-ce33-48aa-a91a-d18f716818cf tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:59.161541 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4f062dd7-ce33-48aa-a91a-d18f716818cf tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:59.162603 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4f062dd7-ce33-48aa-a91a-d18f716818cf tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:54:59.170697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4f062dd7-ce33-48aa-a91a-d18f716818cf tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:54:59.329180 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4f062dd7-ce33-48aa-a91a-d18f716818cf tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:59.337587 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4f062dd7-ce33-48aa-a91a-d18f716818cf tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.188925 Jun 30 17:54:59.338159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 106/226] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:59 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:54:59.389901 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-afc13d32-9579-4df1-83a0-89d6d14e66f3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:54:59.397502 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-afc13d32-9579-4df1-83a0-89d6d14e66f3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.395139 Jun 30 17:54:59.398055 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 121/227] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:54:58 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:00.354484 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-702dc0b1-02ec-44d5-a8ed-4acd6475e792 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:00.355752 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-702dc0b1-02ec-44d5-a8ed-4acd6475e792 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:00.369930 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-702dc0b1-02ec-44d5-a8ed-4acd6475e792 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:00.370798 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-702dc0b1-02ec-44d5-a8ed-4acd6475e792 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:00.371488 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-702dc0b1-02ec-44d5-a8ed-4acd6475e792 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:00.372137 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-702dc0b1-02ec-44d5-a8ed-4acd6475e792 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:00.415198 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e8fd14b6-f645-4413-99b3-b8db21c255cd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:00.415739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e8fd14b6-f645-4413-99b3-b8db21c255cd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:00.434201 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e8fd14b6-f645-4413-99b3-b8db21c255cd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:00.434693 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e8fd14b6-f645-4413-99b3-b8db21c255cd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:00.435479 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e8fd14b6-f645-4413-99b3-b8db21c255cd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:00.435915 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e8fd14b6-f645-4413-99b3-b8db21c255cd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:00.668003 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-702dc0b1-02ec-44d5-a8ed-4acd6475e792 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:00.687729 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-702dc0b1-02ec-44d5-a8ed-4acd6475e792 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.333810 Jun 30 17:55:00.691597 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 107/228] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:00 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:00.731469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e8fd14b6-f645-4413-99b3-b8db21c255cd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:00.740680 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e8fd14b6-f645-4413-99b3-b8db21c255cd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.329819 Jun 30 17:55:00.743258 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 122/229] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:00 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:01.709216 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a97a64a2-d989-4b0d-a105-2476629d6545 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:01.709781 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a97a64a2-d989-4b0d-a105-2476629d6545 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:01.717291 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a97a64a2-d989-4b0d-a105-2476629d6545 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:01.717737 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a97a64a2-d989-4b0d-a105-2476629d6545 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:01.718523 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a97a64a2-d989-4b0d-a105-2476629d6545 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:01.718961 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a97a64a2-d989-4b0d-a105-2476629d6545 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:01.759983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-40605c41-ea6c-4a21-82e8-ce7b91337f1a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:01.760589 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-40605c41-ea6c-4a21-82e8-ce7b91337f1a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:01.767110 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-40605c41-ea6c-4a21-82e8-ce7b91337f1a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:01.767557 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-40605c41-ea6c-4a21-82e8-ce7b91337f1a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:01.768308 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-40605c41-ea6c-4a21-82e8-ce7b91337f1a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:01.768735 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-40605c41-ea6c-4a21-82e8-ce7b91337f1a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:01.847849 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a97a64a2-d989-4b0d-a105-2476629d6545 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:01.855951 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a97a64a2-d989-4b0d-a105-2476629d6545 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150649 Jun 30 17:55:01.856719 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 108/230] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:01 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:01.899830 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-40605c41-ea6c-4a21-82e8-ce7b91337f1a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:01.907850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-40605c41-ea6c-4a21-82e8-ce7b91337f1a tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.151055 Jun 30 17:55:01.908403 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 123/231] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:01 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:02.872613 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-320cacaa-09bb-4ab4-bfa4-326322c72aa5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:02.873218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-320cacaa-09bb-4ab4-bfa4-326322c72aa5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:02.879776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-320cacaa-09bb-4ab4-bfa4-326322c72aa5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:02.880233 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-320cacaa-09bb-4ab4-bfa4-326322c72aa5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:02.880984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-320cacaa-09bb-4ab4-bfa4-326322c72aa5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:02.881415 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-320cacaa-09bb-4ab4-bfa4-326322c72aa5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:02.924820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-39e7da0b-0093-463c-aa9e-5d408b24739b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:02.925516 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-39e7da0b-0093-463c-aa9e-5d408b24739b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:02.931853 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-39e7da0b-0093-463c-aa9e-5d408b24739b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:02.932392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-39e7da0b-0093-463c-aa9e-5d408b24739b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:02.933246 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-39e7da0b-0093-463c-aa9e-5d408b24739b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:02.933787 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-39e7da0b-0093-463c-aa9e-5d408b24739b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:03.018212 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-320cacaa-09bb-4ab4-bfa4-326322c72aa5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:03.026204 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-320cacaa-09bb-4ab4-bfa4-326322c72aa5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.157393 Jun 30 17:55:03.026807 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 109/232] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:02 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:03.064953 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-39e7da0b-0093-463c-aa9e-5d408b24739b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:03.072708 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-39e7da0b-0093-463c-aa9e-5d408b24739b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.152233 Jun 30 17:55:03.073277 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 124/233] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:02 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:04.042941 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-abc1dd65-8cfd-4520-9aa5-c9db2877ccea tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:04.043582 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-abc1dd65-8cfd-4520-9aa5-c9db2877ccea tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:04.051021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-abc1dd65-8cfd-4520-9aa5-c9db2877ccea tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:04.051474 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-abc1dd65-8cfd-4520-9aa5-c9db2877ccea tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:04.052611 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-abc1dd65-8cfd-4520-9aa5-c9db2877ccea tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:04.053053 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-abc1dd65-8cfd-4520-9aa5-c9db2877ccea tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:04.088865 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-408dea84-4c39-4e00-a1b0-b00712d8ace3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:04.089614 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-408dea84-4c39-4e00-a1b0-b00712d8ace3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:04.095909 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-408dea84-4c39-4e00-a1b0-b00712d8ace3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:04.096358 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-408dea84-4c39-4e00-a1b0-b00712d8ace3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:04.097130 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-408dea84-4c39-4e00-a1b0-b00712d8ace3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:04.097563 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-408dea84-4c39-4e00-a1b0-b00712d8ace3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:04.181775 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-abc1dd65-8cfd-4520-9aa5-c9db2877ccea tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:04.190007 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-abc1dd65-8cfd-4520-9aa5-c9db2877ccea tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150913 Jun 30 17:55:04.190610 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 110/234] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:04 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:04.228285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-408dea84-4c39-4e00-a1b0-b00712d8ace3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:04.237025 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-408dea84-4c39-4e00-a1b0-b00712d8ace3 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.151301 Jun 30 17:55:04.237595 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 125/235] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:04 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:05.207486 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5bdffe3a-672c-44cb-9248-bd09d855add6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:05.208088 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5bdffe3a-672c-44cb-9248-bd09d855add6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:05.214520 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5bdffe3a-672c-44cb-9248-bd09d855add6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:05.214966 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5bdffe3a-672c-44cb-9248-bd09d855add6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:05.215711 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5bdffe3a-672c-44cb-9248-bd09d855add6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:05.216136 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5bdffe3a-672c-44cb-9248-bd09d855add6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:05.253787 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8e216415-5008-4cc3-b5f4-002a24f01832 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:05.254305 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8e216415-5008-4cc3-b5f4-002a24f01832 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:05.260393 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8e216415-5008-4cc3-b5f4-002a24f01832 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:05.260833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8e216415-5008-4cc3-b5f4-002a24f01832 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:05.261625 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8e216415-5008-4cc3-b5f4-002a24f01832 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:05.262053 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8e216415-5008-4cc3-b5f4-002a24f01832 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:05.342375 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-5bdffe3a-672c-44cb-9248-bd09d855add6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:05.359487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5bdffe3a-672c-44cb-9248-bd09d855add6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.156320 Jun 30 17:55:05.360788 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 111/236] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:05 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:05.388945 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8e216415-5008-4cc3-b5f4-002a24f01832 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:05.396285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8e216415-5008-4cc3-b5f4-002a24f01832 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.146853 Jun 30 17:55:05.397048 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 126/237] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:05 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:06.376820 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-16b3b9c4-fb20-4015-8f4c-130515434065 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:06.377939 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-16b3b9c4-fb20-4015-8f4c-130515434065 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:06.384570 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16b3b9c4-fb20-4015-8f4c-130515434065 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:06.385013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16b3b9c4-fb20-4015-8f4c-130515434065 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:06.385790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16b3b9c4-fb20-4015-8f4c-130515434065 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:06.386224 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-16b3b9c4-fb20-4015-8f4c-130515434065 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:06.413255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-95cb01e1-c02c-4d17-9e9a-3d19e1aa0b09 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:06.413875 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-95cb01e1-c02c-4d17-9e9a-3d19e1aa0b09 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:06.420381 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-95cb01e1-c02c-4d17-9e9a-3d19e1aa0b09 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:06.420917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-95cb01e1-c02c-4d17-9e9a-3d19e1aa0b09 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:06.421750 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-95cb01e1-c02c-4d17-9e9a-3d19e1aa0b09 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:06.422251 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-95cb01e1-c02c-4d17-9e9a-3d19e1aa0b09 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:06.525982 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-16b3b9c4-fb20-4015-8f4c-130515434065 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:06.533364 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-16b3b9c4-fb20-4015-8f4c-130515434065 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.160641 Jun 30 17:55:06.533922 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 112/238] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:06 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:06.562257 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-95cb01e1-c02c-4d17-9e9a-3d19e1aa0b09 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:06.570114 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-95cb01e1-c02c-4d17-9e9a-3d19e1aa0b09 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.160881 Jun 30 17:55:06.570694 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 127/239] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:06 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:07.549576 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-51a47a46-1b49-4931-96f2-7216cae5505c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:07.550205 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-51a47a46-1b49-4931-96f2-7216cae5505c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:07.556637 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-51a47a46-1b49-4931-96f2-7216cae5505c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:07.557081 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-51a47a46-1b49-4931-96f2-7216cae5505c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:07.557821 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-51a47a46-1b49-4931-96f2-7216cae5505c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:07.558250 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-51a47a46-1b49-4931-96f2-7216cae5505c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:07.587626 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-723c802c-0074-46c9-bfe8-2820298c1991 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:07.588809 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-723c802c-0074-46c9-bfe8-2820298c1991 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:07.594936 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-723c802c-0074-46c9-bfe8-2820298c1991 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:07.595378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-723c802c-0074-46c9-bfe8-2820298c1991 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:07.596126 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-723c802c-0074-46c9-bfe8-2820298c1991 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:07.596552 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-723c802c-0074-46c9-bfe8-2820298c1991 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:07.690745 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-51a47a46-1b49-4931-96f2-7216cae5505c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:07.699172 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-51a47a46-1b49-4931-96f2-7216cae5505c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.153165 Jun 30 17:55:07.699989 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 113/240] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:07 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:07.732755 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-723c802c-0074-46c9-bfe8-2820298c1991 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:07.740567 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-723c802c-0074-46c9-bfe8-2820298c1991 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.156696 Jun 30 17:55:07.741125 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 128/241] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:07 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:08.716777 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b1dba49a-6048-4c69-88a0-c09b1ce3e08e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:08.717380 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b1dba49a-6048-4c69-88a0-c09b1ce3e08e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:08.724486 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1dba49a-6048-4c69-88a0-c09b1ce3e08e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:08.724930 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1dba49a-6048-4c69-88a0-c09b1ce3e08e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:08.725707 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1dba49a-6048-4c69-88a0-c09b1ce3e08e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:08.726137 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1dba49a-6048-4c69-88a0-c09b1ce3e08e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:08.757427 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b916a373-957c-4a9c-b461-9a04c9fc66ec tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:08.758026 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b916a373-957c-4a9c-b461-9a04c9fc66ec tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:08.764121 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b916a373-957c-4a9c-b461-9a04c9fc66ec tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:08.764558 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b916a373-957c-4a9c-b461-9a04c9fc66ec tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:08.765306 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b916a373-957c-4a9c-b461-9a04c9fc66ec tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:08.765728 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b916a373-957c-4a9c-b461-9a04c9fc66ec tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:08.858818 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b1dba49a-6048-4c69-88a0-c09b1ce3e08e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:08.866506 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b1dba49a-6048-4c69-88a0-c09b1ce3e08e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.153453 Jun 30 17:55:08.867077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 114/242] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:08 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:08.892538 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b916a373-957c-4a9c-b461-9a04c9fc66ec tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:08.899820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b916a373-957c-4a9c-b461-9a04c9fc66ec tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.146211 Jun 30 17:55:08.900379 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 129/243] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:08 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:09.883343 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-008796ad-fc38-4110-bcc7-3d5c70451ab4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:09.883947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-008796ad-fc38-4110-bcc7-3d5c70451ab4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:09.890447 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-008796ad-fc38-4110-bcc7-3d5c70451ab4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:09.890894 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-008796ad-fc38-4110-bcc7-3d5c70451ab4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:09.892156 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-008796ad-fc38-4110-bcc7-3d5c70451ab4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:09.892612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-008796ad-fc38-4110-bcc7-3d5c70451ab4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:09.915744 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1c0adb1e-1e4f-47d4-b2bd-841651b49d22 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:09.916383 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1c0adb1e-1e4f-47d4-b2bd-841651b49d22 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:09.922504 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c0adb1e-1e4f-47d4-b2bd-841651b49d22 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:09.922955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c0adb1e-1e4f-47d4-b2bd-841651b49d22 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:09.923716 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c0adb1e-1e4f-47d4-b2bd-841651b49d22 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:09.924151 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c0adb1e-1e4f-47d4-b2bd-841651b49d22 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:10.057684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-008796ad-fc38-4110-bcc7-3d5c70451ab4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:10.065257 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-008796ad-fc38-4110-bcc7-3d5c70451ab4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.185897 Jun 30 17:55:10.065828 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 115/244] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:09 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:10.090210 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1c0adb1e-1e4f-47d4-b2bd-841651b49d22 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:10.093729 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=100 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:10.099276 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1c0adb1e-1e4f-47d4-b2bd-841651b49d22 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.187335 Jun 30 17:55:10.099831 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 130/245] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:09 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:11.081785 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-74f3dfc0-a5cf-42ad-b21e-c933402e470f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:11.082429 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-74f3dfc0-a5cf-42ad-b21e-c933402e470f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:11.088872 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-74f3dfc0-a5cf-42ad-b21e-c933402e470f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:11.089323 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-74f3dfc0-a5cf-42ad-b21e-c933402e470f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:11.090083 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-74f3dfc0-a5cf-42ad-b21e-c933402e470f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:11.090552 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-74f3dfc0-a5cf-42ad-b21e-c933402e470f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:11.095003 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=100 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:11.116804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5aad7e7a-c7d0-4082-9308-e49b8794c336 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:11.117419 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5aad7e7a-c7d0-4082-9308-e49b8794c336 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:11.123489 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5aad7e7a-c7d0-4082-9308-e49b8794c336 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:11.123931 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5aad7e7a-c7d0-4082-9308-e49b8794c336 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:11.124689 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5aad7e7a-c7d0-4082-9308-e49b8794c336 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:11.125121 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5aad7e7a-c7d0-4082-9308-e49b8794c336 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:11.221337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-74f3dfc0-a5cf-42ad-b21e-c933402e470f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:11.228857 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-74f3dfc0-a5cf-42ad-b21e-c933402e470f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150784 Jun 30 17:55:11.229431 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 116/246] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:11 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:11.252762 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-5aad7e7a-c7d0-4082-9308-e49b8794c336 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:11.260057 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5aad7e7a-c7d0-4082-9308-e49b8794c336 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.147351 Jun 30 17:55:11.260610 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 131/247] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:11 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:12.246041 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0b66773d-9b3a-451a-b2c7-b10db3350820 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:12.246585 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0b66773d-9b3a-451a-b2c7-b10db3350820 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:12.253681 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b66773d-9b3a-451a-b2c7-b10db3350820 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:12.254124 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b66773d-9b3a-451a-b2c7-b10db3350820 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:12.254912 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b66773d-9b3a-451a-b2c7-b10db3350820 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:12.255347 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b66773d-9b3a-451a-b2c7-b10db3350820 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:12.277396 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-707d7325-ada0-49ff-aa82-e722d0329533 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:12.278013 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-707d7325-ada0-49ff-aa82-e722d0329533 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:12.284133 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-707d7325-ada0-49ff-aa82-e722d0329533 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:12.284581 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-707d7325-ada0-49ff-aa82-e722d0329533 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:12.285333 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-707d7325-ada0-49ff-aa82-e722d0329533 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:12.285762 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-707d7325-ada0-49ff-aa82-e722d0329533 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:12.387692 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0b66773d-9b3a-451a-b2c7-b10db3350820 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:12.395374 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0b66773d-9b3a-451a-b2c7-b10db3350820 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.153120 Jun 30 17:55:12.395900 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 117/248] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:12 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:12.415331 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-707d7325-ada0-49ff-aa82-e722d0329533 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:12.423252 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-707d7325-ada0-49ff-aa82-e722d0329533 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.149299 Jun 30 17:55:12.423810 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 132/249] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:12 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:13.412360 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7e485ef0-0a25-4fed-ad45-2c601f8fe480 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:13.412964 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7e485ef0-0a25-4fed-ad45-2c601f8fe480 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:13.419718 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7e485ef0-0a25-4fed-ad45-2c601f8fe480 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:13.420166 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7e485ef0-0a25-4fed-ad45-2c601f8fe480 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:13.420921 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7e485ef0-0a25-4fed-ad45-2c601f8fe480 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:13.421354 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7e485ef0-0a25-4fed-ad45-2c601f8fe480 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:13.440273 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1a3fb433-439f-477f-b4a6-730661f944d9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:13.440273 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1a3fb433-439f-477f-b4a6-730661f944d9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:13.446845 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1a3fb433-439f-477f-b4a6-730661f944d9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:13.447353 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1a3fb433-439f-477f-b4a6-730661f944d9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:13.448105 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1a3fb433-439f-477f-b4a6-730661f944d9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:13.448532 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1a3fb433-439f-477f-b4a6-730661f944d9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:13.551500 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7e485ef0-0a25-4fed-ad45-2c601f8fe480 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:13.558837 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7e485ef0-0a25-4fed-ad45-2c601f8fe480 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150290 Jun 30 17:55:13.559405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 118/250] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:13 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:13.577716 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1a3fb433-439f-477f-b4a6-730661f944d9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:13.585564 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1a3fb433-439f-477f-b4a6-730661f944d9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.149680 Jun 30 17:55:13.586120 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 133/251] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:13 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:14.575879 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a8e0b0a8-00e4-490e-a28e-f469e7f1c5e7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:14.576466 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a8e0b0a8-00e4-490e-a28e-f469e7f1c5e7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:14.583029 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a8e0b0a8-00e4-490e-a28e-f469e7f1c5e7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:14.583475 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a8e0b0a8-00e4-490e-a28e-f469e7f1c5e7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:14.584226 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a8e0b0a8-00e4-490e-a28e-f469e7f1c5e7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:14.584661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a8e0b0a8-00e4-490e-a28e-f469e7f1c5e7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:14.602491 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9b744d49-6055-4f07-a323-49a07cca1b19 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:14.603742 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-9b744d49-6055-4f07-a323-49a07cca1b19 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:14.610829 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9b744d49-6055-4f07-a323-49a07cca1b19 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:14.611278 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9b744d49-6055-4f07-a323-49a07cca1b19 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:14.612045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9b744d49-6055-4f07-a323-49a07cca1b19 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:14.612479 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9b744d49-6055-4f07-a323-49a07cca1b19 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:14.726698 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a8e0b0a8-00e4-490e-a28e-f469e7f1c5e7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:14.734302 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a8e0b0a8-00e4-490e-a28e-f469e7f1c5e7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.162472 Jun 30 17:55:14.734963 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 119/252] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:14 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:14.746241 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-9b744d49-6055-4f07-a323-49a07cca1b19 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:14.753579 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-9b744d49-6055-4f07-a323-49a07cca1b19 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.155178 Jun 30 17:55:14.754132 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 134/253] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:14 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:15.751872 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-fa59a1f8-adf8-4476-b686-dfb125a00b7e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:15.752394 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-fa59a1f8-adf8-4476-b686-dfb125a00b7e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:15.758497 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fa59a1f8-adf8-4476-b686-dfb125a00b7e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:15.758943 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fa59a1f8-adf8-4476-b686-dfb125a00b7e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:15.759682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fa59a1f8-adf8-4476-b686-dfb125a00b7e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:15.760113 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fa59a1f8-adf8-4476-b686-dfb125a00b7e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:15.770003 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-adc76f0d-8c1b-41be-a5bf-4860fa2e1323 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:15.770637 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-adc76f0d-8c1b-41be-a5bf-4860fa2e1323 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:15.776896 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-adc76f0d-8c1b-41be-a5bf-4860fa2e1323 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:15.777390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-adc76f0d-8c1b-41be-a5bf-4860fa2e1323 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:15.778066 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-adc76f0d-8c1b-41be-a5bf-4860fa2e1323 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:15.778535 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-adc76f0d-8c1b-41be-a5bf-4860fa2e1323 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:15.891125 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-fa59a1f8-adf8-4476-b686-dfb125a00b7e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:15.899252 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-fa59a1f8-adf8-4476-b686-dfb125a00b7e tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.151212 Jun 30 17:55:15.899617 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 120/254] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:15 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:15.917279 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-adc76f0d-8c1b-41be-a5bf-4860fa2e1323 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:15.924568 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-adc76f0d-8c1b-41be-a5bf-4860fa2e1323 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.158420 Jun 30 17:55:15.925133 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 135/255] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:15 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:16.916085 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7fcfd1ce-7272-4c53-a814-2f9c26eddefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:16.916693 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7fcfd1ce-7272-4c53-a814-2f9c26eddefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:16.923627 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7fcfd1ce-7272-4c53-a814-2f9c26eddefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:16.924076 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7fcfd1ce-7272-4c53-a814-2f9c26eddefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:16.924837 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7fcfd1ce-7272-4c53-a814-2f9c26eddefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:16.925272 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7fcfd1ce-7272-4c53-a814-2f9c26eddefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:16.941454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6ac3a81c-b028-46ec-9ddc-76ce978dd3e9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:16.942852 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6ac3a81c-b028-46ec-9ddc-76ce978dd3e9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:16.949083 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6ac3a81c-b028-46ec-9ddc-76ce978dd3e9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:16.949599 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6ac3a81c-b028-46ec-9ddc-76ce978dd3e9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:16.950413 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6ac3a81c-b028-46ec-9ddc-76ce978dd3e9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:16.950903 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6ac3a81c-b028-46ec-9ddc-76ce978dd3e9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:17.077342 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7fcfd1ce-7272-4c53-a814-2f9c26eddefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:17.083223 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6ac3a81c-b028-46ec-9ddc-76ce978dd3e9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:17.085878 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7fcfd1ce-7272-4c53-a814-2f9c26eddefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.173506 Jun 30 17:55:17.086667 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 121/256] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:16 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:17.091339 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6ac3a81c-b028-46ec-9ddc-76ce978dd3e9 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.154313 Jun 30 17:55:17.091892 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 136/257] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:16 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:18.102952 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-42ed06c6-8ae5-46b7-8d61-d935c0d21998 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:18.103616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-42ed06c6-8ae5-46b7-8d61-d935c0d21998 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:18.107969 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bb4331cb-389d-4e89-8d19-803ee6675c83 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:18.108568 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-bb4331cb-389d-4e89-8d19-803ee6675c83 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:18.110256 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-42ed06c6-8ae5-46b7-8d61-d935c0d21998 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:18.110730 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-42ed06c6-8ae5-46b7-8d61-d935c0d21998 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:18.112000 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-42ed06c6-8ae5-46b7-8d61-d935c0d21998 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:18.112434 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-42ed06c6-8ae5-46b7-8d61-d935c0d21998 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:18.114991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bb4331cb-389d-4e89-8d19-803ee6675c83 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:18.115428 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bb4331cb-389d-4e89-8d19-803ee6675c83 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:18.116175 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bb4331cb-389d-4e89-8d19-803ee6675c83 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:18.116599 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bb4331cb-389d-4e89-8d19-803ee6675c83 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:18.250616 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bb4331cb-389d-4e89-8d19-803ee6675c83 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:18.258657 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-bb4331cb-389d-4e89-8d19-803ee6675c83 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.154313 Jun 30 17:55:18.259226 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 137/258] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:18 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:18.260737 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-42ed06c6-8ae5-46b7-8d61-d935c0d21998 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:18.268480 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-42ed06c6-8ae5-46b7-8d61-d935c0d21998 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.169327 Jun 30 17:55:18.269035 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 122/259] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:18 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:19.275913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4a342291-5ac0-4ecc-ac20-1294a3eee6d5 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:19.276518 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4a342291-5ac0-4ecc-ac20-1294a3eee6d5 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:19.283380 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4a342291-5ac0-4ecc-ac20-1294a3eee6d5 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:19.283854 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4a342291-5ac0-4ecc-ac20-1294a3eee6d5 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:19.284609 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4a342291-5ac0-4ecc-ac20-1294a3eee6d5 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:19.285029 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-15aa97d7-f765-4d05-9083-63b74a1fcd04 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:19.285487 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4a342291-5ac0-4ecc-ac20-1294a3eee6d5 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:19.285634 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-15aa97d7-f765-4d05-9083-63b74a1fcd04 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:19.292114 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-15aa97d7-f765-4d05-9083-63b74a1fcd04 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:19.292551 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-15aa97d7-f765-4d05-9083-63b74a1fcd04 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:19.293297 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-15aa97d7-f765-4d05-9083-63b74a1fcd04 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:19.293722 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-15aa97d7-f765-4d05-9083-63b74a1fcd04 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:19.413065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4a342291-5ac0-4ecc-ac20-1294a3eee6d5 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:19.418144 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-15aa97d7-f765-4d05-9083-63b74a1fcd04 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:19.420601 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4a342291-5ac0-4ecc-ac20-1294a3eee6d5 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.148596 Jun 30 17:55:19.421422 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 138/260] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:19 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:19.426641 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-15aa97d7-f765-4d05-9083-63b74a1fcd04 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.145550 Jun 30 17:55:19.426994 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 123/261] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:19 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:20.437739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-60b711e1-c24a-410c-936e-2dbc8eab69cc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:20.438377 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-60b711e1-c24a-410c-936e-2dbc8eab69cc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:20.443413 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2c08d56e-e507-40af-80cf-6d5a9f52e88c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:20.444051 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2c08d56e-e507-40af-80cf-6d5a9f52e88c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:20.444388 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-60b711e1-c24a-410c-936e-2dbc8eab69cc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:20.444829 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-60b711e1-c24a-410c-936e-2dbc8eab69cc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:20.445578 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-60b711e1-c24a-410c-936e-2dbc8eab69cc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:20.446009 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-60b711e1-c24a-410c-936e-2dbc8eab69cc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:20.450770 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2c08d56e-e507-40af-80cf-6d5a9f52e88c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:20.451217 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2c08d56e-e507-40af-80cf-6d5a9f52e88c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:20.451978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2c08d56e-e507-40af-80cf-6d5a9f52e88c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:20.452420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2c08d56e-e507-40af-80cf-6d5a9f52e88c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:20.584021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2c08d56e-e507-40af-80cf-6d5a9f52e88c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:20.584199 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-60b711e1-c24a-410c-936e-2dbc8eab69cc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:20.591916 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-60b711e1-c24a-410c-936e-2dbc8eab69cc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.157943 Jun 30 17:55:20.592080 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2c08d56e-e507-40af-80cf-6d5a9f52e88c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.152324 Jun 30 17:55:20.592672 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 139/262] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:20 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:20.594677 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 124/263] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:20 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:21.608246 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-f77cfc79-553c-4a45-b0e4-e641fca067da tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:21.608771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0c96790a-82d7-4270-a6ec-1c4aefd5b16c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:21.609170 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-f77cfc79-553c-4a45-b0e4-e641fca067da tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:21.609280 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0c96790a-82d7-4270-a6ec-1c4aefd5b16c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:21.615485 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f77cfc79-553c-4a45-b0e4-e641fca067da tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:21.615925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f77cfc79-553c-4a45-b0e4-e641fca067da tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:21.616312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c96790a-82d7-4270-a6ec-1c4aefd5b16c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:21.616675 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f77cfc79-553c-4a45-b0e4-e641fca067da tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:21.616777 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c96790a-82d7-4270-a6ec-1c4aefd5b16c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:21.617103 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f77cfc79-553c-4a45-b0e4-e641fca067da tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:21.617493 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c96790a-82d7-4270-a6ec-1c4aefd5b16c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:21.617922 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c96790a-82d7-4270-a6ec-1c4aefd5b16c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:21.746275 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0c96790a-82d7-4270-a6ec-1c4aefd5b16c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:21.748976 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-f77cfc79-553c-4a45-b0e4-e641fca067da tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:21.757820 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-f77cfc79-553c-4a45-b0e4-e641fca067da tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.153236 Jun 30 17:55:21.757970 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0c96790a-82d7-4270-a6ec-1c4aefd5b16c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.151508 Jun 30 17:55:21.758672 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 125/264] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:21 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:21.768857 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 140/265] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:21 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:22.774809 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7a364a08-8621-42fa-ba70-e8fcd12e9e21 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:22.775500 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7a364a08-8621-42fa-ba70-e8fcd12e9e21 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:22.775924 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-36fe2bcf-1598-47cf-94d4-7930f3a1943c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:22.776533 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-36fe2bcf-1598-47cf-94d4-7930f3a1943c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:22.782761 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-36fe2bcf-1598-47cf-94d4-7930f3a1943c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:22.783203 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-36fe2bcf-1598-47cf-94d4-7930f3a1943c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:22.783683 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7a364a08-8621-42fa-ba70-e8fcd12e9e21 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:22.783957 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-36fe2bcf-1598-47cf-94d4-7930f3a1943c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:22.784128 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7a364a08-8621-42fa-ba70-e8fcd12e9e21 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:22.784394 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-36fe2bcf-1598-47cf-94d4-7930f3a1943c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:22.784874 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7a364a08-8621-42fa-ba70-e8fcd12e9e21 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:22.785302 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7a364a08-8621-42fa-ba70-e8fcd12e9e21 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:22.927492 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-36fe2bcf-1598-47cf-94d4-7930f3a1943c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:22.935239 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-36fe2bcf-1598-47cf-94d4-7930f3a1943c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.163015 Jun 30 17:55:22.935902 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 141/266] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:22 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:23.280797 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7a364a08-8621-42fa-ba70-e8fcd12e9e21 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:23.288684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7a364a08-8621-42fa-ba70-e8fcd12e9e21 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.517958 Jun 30 17:55:23.289236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 126/267] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:22 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:23.952359 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ca3a69b0-2cb7-4ec1-897c-4ba0abada3b9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:23.952957 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ca3a69b0-2cb7-4ec1-897c-4ba0abada3b9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:23.959587 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ca3a69b0-2cb7-4ec1-897c-4ba0abada3b9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:23.960030 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ca3a69b0-2cb7-4ec1-897c-4ba0abada3b9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:23.960774 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ca3a69b0-2cb7-4ec1-897c-4ba0abada3b9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:23.961200 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ca3a69b0-2cb7-4ec1-897c-4ba0abada3b9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:24.091094 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-ca3a69b0-2cb7-4ec1-897c-4ba0abada3b9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:24.098403 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ca3a69b0-2cb7-4ec1-897c-4ba0abada3b9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.149844 Jun 30 17:55:24.098960 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 142/268] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:23 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:24.305121 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b43adc42-8b55-4b23-b7ac-09de5e331ea1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:24.305723 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b43adc42-8b55-4b23-b7ac-09de5e331ea1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:24.308121 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=50 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:24.313474 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b43adc42-8b55-4b23-b7ac-09de5e331ea1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:24.314590 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b43adc42-8b55-4b23-b7ac-09de5e331ea1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:24.315337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b43adc42-8b55-4b23-b7ac-09de5e331ea1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:24.315765 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b43adc42-8b55-4b23-b7ac-09de5e331ea1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:24.439496 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b43adc42-8b55-4b23-b7ac-09de5e331ea1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:24.446969 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b43adc42-8b55-4b23-b7ac-09de5e331ea1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.145739 Jun 30 17:55:24.447523 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 127/269] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:24 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:25.114906 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a93fff9b-8f96-4dfc-8f93-f2fdbb1e944c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:25.115516 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a93fff9b-8f96-4dfc-8f93-f2fdbb1e944c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:25.121619 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a93fff9b-8f96-4dfc-8f93-f2fdbb1e944c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:25.122063 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a93fff9b-8f96-4dfc-8f93-f2fdbb1e944c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:25.122842 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a93fff9b-8f96-4dfc-8f93-f2fdbb1e944c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:25.123272 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a93fff9b-8f96-4dfc-8f93-f2fdbb1e944c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:25.248009 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-a93fff9b-8f96-4dfc-8f93-f2fdbb1e944c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:25.255894 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a93fff9b-8f96-4dfc-8f93-f2fdbb1e944c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.144822 Jun 30 17:55:25.256454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 143/270] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:25 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:25.463752 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-083d5258-e466-47a2-a81d-d7dfbf6662f1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:25.464355 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-083d5258-e466-47a2-a81d-d7dfbf6662f1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:25.471027 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-083d5258-e466-47a2-a81d-d7dfbf6662f1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:25.471466 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-083d5258-e466-47a2-a81d-d7dfbf6662f1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:25.472211 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-083d5258-e466-47a2-a81d-d7dfbf6662f1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:25.472639 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-083d5258-e466-47a2-a81d-d7dfbf6662f1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:25.598869 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-083d5258-e466-47a2-a81d-d7dfbf6662f1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:25.606078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-083d5258-e466-47a2-a81d-d7dfbf6662f1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.146147 Jun 30 17:55:25.606656 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 128/271] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:25 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:26.272985 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-cdb2ac63-067c-4264-be8e-0ba470873d01 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:26.273514 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-cdb2ac63-067c-4264-be8e-0ba470873d01 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:26.275361 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=54 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:26.280628 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cdb2ac63-067c-4264-be8e-0ba470873d01 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:26.281073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cdb2ac63-067c-4264-be8e-0ba470873d01 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:26.281818 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cdb2ac63-067c-4264-be8e-0ba470873d01 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:26.282247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cdb2ac63-067c-4264-be8e-0ba470873d01 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:26.412175 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-cdb2ac63-067c-4264-be8e-0ba470873d01 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:26.419903 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-cdb2ac63-067c-4264-be8e-0ba470873d01 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150763 Jun 30 17:55:26.420543 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 144/272] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:26 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:26.623340 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5defcad9-7a3c-4188-84a6-4da713641bff tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:26.623947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5defcad9-7a3c-4188-84a6-4da713641bff tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:26.630408 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5defcad9-7a3c-4188-84a6-4da713641bff tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:26.630849 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5defcad9-7a3c-4188-84a6-4da713641bff tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:26.631599 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5defcad9-7a3c-4188-84a6-4da713641bff tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:26.632026 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5defcad9-7a3c-4188-84a6-4da713641bff tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:26.756965 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-5defcad9-7a3c-4188-84a6-4da713641bff tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:26.765715 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5defcad9-7a3c-4188-84a6-4da713641bff tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.146152 Jun 30 17:55:26.766278 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 129/273] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:26 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:27.435991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d6058a4e-f048-4a93-afee-e15c0663fefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:27.436598 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-d6058a4e-f048-4a93-afee-e15c0663fefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:27.442614 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d6058a4e-f048-4a93-afee-e15c0663fefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:27.443059 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d6058a4e-f048-4a93-afee-e15c0663fefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:27.443811 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d6058a4e-f048-4a93-afee-e15c0663fefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:27.444241 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d6058a4e-f048-4a93-afee-e15c0663fefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:27.573155 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-d6058a4e-f048-4a93-afee-e15c0663fefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:27.580632 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d6058a4e-f048-4a93-afee-e15c0663fefd tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.148417 Jun 30 17:55:27.581190 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 145/274] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:27 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:27.782267 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-55d511e1-26ad-4cc3-8bef-c96d4bdf7de0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:27.782882 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-55d511e1-26ad-4cc3-8bef-c96d4bdf7de0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:27.789933 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-55d511e1-26ad-4cc3-8bef-c96d4bdf7de0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:27.790428 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-55d511e1-26ad-4cc3-8bef-c96d4bdf7de0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:27.791190 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-55d511e1-26ad-4cc3-8bef-c96d4bdf7de0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:27.791624 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-55d511e1-26ad-4cc3-8bef-c96d4bdf7de0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:27.917947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-55d511e1-26ad-4cc3-8bef-c96d4bdf7de0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:27.926014 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-55d511e1-26ad-4cc3-8bef-c96d4bdf7de0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.147867 Jun 30 17:55:27.926603 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 130/275] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:27 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:28.597075 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bdffaf54-f88c-4e1c-8e3b-c5cea3f64351 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:28.597683 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-bdffaf54-f88c-4e1c-8e3b-c5cea3f64351 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:28.603953 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bdffaf54-f88c-4e1c-8e3b-c5cea3f64351 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:28.604401 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bdffaf54-f88c-4e1c-8e3b-c5cea3f64351 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:28.605156 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bdffaf54-f88c-4e1c-8e3b-c5cea3f64351 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:28.605732 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bdffaf54-f88c-4e1c-8e3b-c5cea3f64351 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:28.731796 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bdffaf54-f88c-4e1c-8e3b-c5cea3f64351 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:28.739682 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-bdffaf54-f88c-4e1c-8e3b-c5cea3f64351 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.146494 Jun 30 17:55:28.740239 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 146/276] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:28 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:28.942075 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0ab926ef-7f9c-4d48-b289-620a5e5d4315 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:28.942707 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0ab926ef-7f9c-4d48-b289-620a5e5d4315 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:28.949316 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0ab926ef-7f9c-4d48-b289-620a5e5d4315 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:28.949756 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0ab926ef-7f9c-4d48-b289-620a5e5d4315 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:28.950528 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0ab926ef-7f9c-4d48-b289-620a5e5d4315 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:28.951128 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0ab926ef-7f9c-4d48-b289-620a5e5d4315 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:29.080342 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0ab926ef-7f9c-4d48-b289-620a5e5d4315 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:29.088077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0ab926ef-7f9c-4d48-b289-620a5e5d4315 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.149786 Jun 30 17:55:29.088969 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 131/277] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:28 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:29.756784 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4c93ede0-2309-4343-9ef0-64d00e7a7a17 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:29.757315 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4c93ede0-2309-4343-9ef0-64d00e7a7a17 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:29.763688 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4c93ede0-2309-4343-9ef0-64d00e7a7a17 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:29.764133 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4c93ede0-2309-4343-9ef0-64d00e7a7a17 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:29.765068 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4c93ede0-2309-4343-9ef0-64d00e7a7a17 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:29.765866 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4c93ede0-2309-4343-9ef0-64d00e7a7a17 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:29.787265 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=100 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:29.899792 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4c93ede0-2309-4343-9ef0-64d00e7a7a17 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:29.917330 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4c93ede0-2309-4343-9ef0-64d00e7a7a17 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.163694 Jun 30 17:55:29.926714 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 147/278] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:29 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:30.104998 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-84b44156-0d40-4811-8d54-e9be71c7aa17 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:30.105607 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-84b44156-0d40-4811-8d54-e9be71c7aa17 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:30.112678 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-84b44156-0d40-4811-8d54-e9be71c7aa17 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:30.113118 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-84b44156-0d40-4811-8d54-e9be71c7aa17 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:30.113858 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-84b44156-0d40-4811-8d54-e9be71c7aa17 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:30.114286 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-84b44156-0d40-4811-8d54-e9be71c7aa17 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:30.241400 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-84b44156-0d40-4811-8d54-e9be71c7aa17 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:30.245317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=100 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:30.249925 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-84b44156-0d40-4811-8d54-e9be71c7aa17 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.148752 Jun 30 17:55:30.250507 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 132/279] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:30 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:30.934399 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a6584303-3c8a-4caf-b348-6cfd11d3e04c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:30.934998 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a6584303-3c8a-4caf-b348-6cfd11d3e04c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:30.940999 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a6584303-3c8a-4caf-b348-6cfd11d3e04c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:30.941442 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a6584303-3c8a-4caf-b348-6cfd11d3e04c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:30.942177 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a6584303-3c8a-4caf-b348-6cfd11d3e04c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:30.942627 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a6584303-3c8a-4caf-b348-6cfd11d3e04c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:31.069947 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-a6584303-3c8a-4caf-b348-6cfd11d3e04c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:31.077635 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a6584303-3c8a-4caf-b348-6cfd11d3e04c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.147192 Jun 30 17:55:31.078184 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 148/280] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:30 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:31.267318 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0b0b0419-8e01-4aa7-9762-585bc52098ee tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:31.268518 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0b0b0419-8e01-4aa7-9762-585bc52098ee tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:31.275068 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b0b0419-8e01-4aa7-9762-585bc52098ee tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:31.275506 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b0b0419-8e01-4aa7-9762-585bc52098ee tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:31.276249 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b0b0419-8e01-4aa7-9762-585bc52098ee tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:31.276679 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0b0b0419-8e01-4aa7-9762-585bc52098ee tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:31.408596 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0b0b0419-8e01-4aa7-9762-585bc52098ee tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:31.416106 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0b0b0419-8e01-4aa7-9762-585bc52098ee tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.153043 Jun 30 17:55:31.416679 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 133/281] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:31 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:32.094865 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a225b3d5-123c-4ac8-a8db-f7526949a5c9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:32.095470 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a225b3d5-123c-4ac8-a8db-f7526949a5c9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:32.101931 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a225b3d5-123c-4ac8-a8db-f7526949a5c9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:32.102413 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a225b3d5-123c-4ac8-a8db-f7526949a5c9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:32.103163 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a225b3d5-123c-4ac8-a8db-f7526949a5c9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:32.103594 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a225b3d5-123c-4ac8-a8db-f7526949a5c9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:32.232994 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-a225b3d5-123c-4ac8-a8db-f7526949a5c9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:32.241453 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a225b3d5-123c-4ac8-a8db-f7526949a5c9 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150219 Jun 30 17:55:32.242214 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 149/282] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:32 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:32.432582 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-14b4e333-4110-4e72-a14f-a72b92b24ce2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:32.433181 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-14b4e333-4110-4e72-a14f-a72b92b24ce2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:32.439651 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-14b4e333-4110-4e72-a14f-a72b92b24ce2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:32.440103 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-14b4e333-4110-4e72-a14f-a72b92b24ce2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:32.440846 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-14b4e333-4110-4e72-a14f-a72b92b24ce2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:32.441274 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-14b4e333-4110-4e72-a14f-a72b92b24ce2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:32.564590 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-14b4e333-4110-4e72-a14f-a72b92b24ce2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:32.572207 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-14b4e333-4110-4e72-a14f-a72b92b24ce2 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.143447 Jun 30 17:55:32.572770 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 134/283] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:32 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:33.259352 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a6df39c0-b725-40af-b872-f267f66980a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:33.259879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a6df39c0-b725-40af-b872-f267f66980a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:33.265841 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a6df39c0-b725-40af-b872-f267f66980a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:33.266281 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a6df39c0-b725-40af-b872-f267f66980a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:33.267062 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a6df39c0-b725-40af-b872-f267f66980a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:33.267484 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a6df39c0-b725-40af-b872-f267f66980a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:33.392300 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-a6df39c0-b725-40af-b872-f267f66980a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:33.399789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a6df39c0-b725-40af-b872-f267f66980a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.144329 Jun 30 17:55:33.400346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 150/284] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:33 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:33.589317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3bb672bd-5c23-4700-9f63-01730b289eeb tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:33.589929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3bb672bd-5c23-4700-9f63-01730b289eeb tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:33.596943 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3bb672bd-5c23-4700-9f63-01730b289eeb tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:33.597389 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3bb672bd-5c23-4700-9f63-01730b289eeb tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:33.598172 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3bb672bd-5c23-4700-9f63-01730b289eeb tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:33.598631 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3bb672bd-5c23-4700-9f63-01730b289eeb tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:33.729430 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3bb672bd-5c23-4700-9f63-01730b289eeb tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:33.739993 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3bb672bd-5c23-4700-9f63-01730b289eeb tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.154288 Jun 30 17:55:33.740590 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 135/285] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:33 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:34.419535 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3b0ec868-41de-4510-a7c7-3c75c0bbff4b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:34.420133 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3b0ec868-41de-4510-a7c7-3c75c0bbff4b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:34.426106 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3b0ec868-41de-4510-a7c7-3c75c0bbff4b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:34.426577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3b0ec868-41de-4510-a7c7-3c75c0bbff4b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:34.427318 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3b0ec868-41de-4510-a7c7-3c75c0bbff4b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:34.427738 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3b0ec868-41de-4510-a7c7-3c75c0bbff4b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:34.552234 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3b0ec868-41de-4510-a7c7-3c75c0bbff4b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:34.559964 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3b0ec868-41de-4510-a7c7-3c75c0bbff4b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.144181 Jun 30 17:55:34.560535 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 151/286] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:34 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:34.757952 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d4e10bb0-84a3-4821-8072-d10a8c1e7a10 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:34.758584 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d4e10bb0-84a3-4821-8072-d10a8c1e7a10 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:34.765015 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d4e10bb0-84a3-4821-8072-d10a8c1e7a10 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:34.765466 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d4e10bb0-84a3-4821-8072-d10a8c1e7a10 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:34.766213 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d4e10bb0-84a3-4821-8072-d10a8c1e7a10 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:34.766761 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d4e10bb0-84a3-4821-8072-d10a8c1e7a10 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:34.895235 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d4e10bb0-84a3-4821-8072-d10a8c1e7a10 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:34.902565 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d4e10bb0-84a3-4821-8072-d10a8c1e7a10 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.148567 Jun 30 17:55:34.903123 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 136/287] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:34 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:35.577135 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b08f8631-f517-4a5d-82ec-d079858545c6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:35.577740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b08f8631-f517-4a5d-82ec-d079858545c6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:35.584274 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b08f8631-f517-4a5d-82ec-d079858545c6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:35.584716 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b08f8631-f517-4a5d-82ec-d079858545c6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:35.585457 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b08f8631-f517-4a5d-82ec-d079858545c6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:35.585887 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b08f8631-f517-4a5d-82ec-d079858545c6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:35.713191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b08f8631-f517-4a5d-82ec-d079858545c6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:35.720553 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b08f8631-f517-4a5d-82ec-d079858545c6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.147221 Jun 30 17:55:35.721111 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 152/288] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:35 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:35.919954 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ccca8e32-3ec0-41d9-b180-61a03ca7038f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:35.920503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ccca8e32-3ec0-41d9-b180-61a03ca7038f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:35.926903 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ccca8e32-3ec0-41d9-b180-61a03ca7038f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:35.927347 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ccca8e32-3ec0-41d9-b180-61a03ca7038f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:35.928098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ccca8e32-3ec0-41d9-b180-61a03ca7038f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:35.928528 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ccca8e32-3ec0-41d9-b180-61a03ca7038f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:36.054631 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ccca8e32-3ec0-41d9-b180-61a03ca7038f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:36.061978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ccca8e32-3ec0-41d9-b180-61a03ca7038f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.145993 Jun 30 17:55:36.062580 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 137/289] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:35 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:36.737775 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-0dfaea5a-ee4e-49a8-8008-5bdf040af9f3 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:36.738402 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-0dfaea5a-ee4e-49a8-8008-5bdf040af9f3 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:36.744406 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0dfaea5a-ee4e-49a8-8008-5bdf040af9f3 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:36.744848 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0dfaea5a-ee4e-49a8-8008-5bdf040af9f3 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:36.745597 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0dfaea5a-ee4e-49a8-8008-5bdf040af9f3 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:36.746029 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0dfaea5a-ee4e-49a8-8008-5bdf040af9f3 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:36.875889 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-0dfaea5a-ee4e-49a8-8008-5bdf040af9f3 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:36.883397 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-0dfaea5a-ee4e-49a8-8008-5bdf040af9f3 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150028 Jun 30 17:55:36.883951 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 153/290] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:36 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:37.080987 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a1f1563c-e5da-4ab4-b55c-cc2979b7b9d0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:37.081624 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a1f1563c-e5da-4ab4-b55c-cc2979b7b9d0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:37.088138 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a1f1563c-e5da-4ab4-b55c-cc2979b7b9d0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:37.088590 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a1f1563c-e5da-4ab4-b55c-cc2979b7b9d0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:37.089341 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a1f1563c-e5da-4ab4-b55c-cc2979b7b9d0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:37.089774 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a1f1563c-e5da-4ab4-b55c-cc2979b7b9d0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:37.220966 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a1f1563c-e5da-4ab4-b55c-cc2979b7b9d0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:37.228470 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a1f1563c-e5da-4ab4-b55c-cc2979b7b9d0 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.151888 Jun 30 17:55:37.229031 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 138/291] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:37 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:37.899960 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d37b3045-7b40-4ddf-8966-524e98806526 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:37.900568 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-d37b3045-7b40-4ddf-8966-524e98806526 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:37.907234 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d37b3045-7b40-4ddf-8966-524e98806526 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:37.907685 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d37b3045-7b40-4ddf-8966-524e98806526 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:37.908960 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d37b3045-7b40-4ddf-8966-524e98806526 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:37.909433 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d37b3045-7b40-4ddf-8966-524e98806526 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:38.039545 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-d37b3045-7b40-4ddf-8966-524e98806526 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:38.046782 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d37b3045-7b40-4ddf-8966-524e98806526 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150733 Jun 30 17:55:38.047337 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 154/292] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:37 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:38.245925 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-77287ff3-05df-436a-9e11-7fa05c803eb6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:38.246507 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-77287ff3-05df-436a-9e11-7fa05c803eb6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:38.253362 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-77287ff3-05df-436a-9e11-7fa05c803eb6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:38.253803 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-77287ff3-05df-436a-9e11-7fa05c803eb6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:38.254857 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-77287ff3-05df-436a-9e11-7fa05c803eb6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:38.255613 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-77287ff3-05df-436a-9e11-7fa05c803eb6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:38.387789 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-77287ff3-05df-436a-9e11-7fa05c803eb6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:38.395741 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-77287ff3-05df-436a-9e11-7fa05c803eb6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.153814 Jun 30 17:55:38.396506 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 139/293] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:38 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:39.063268 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5897a5b5-d9c8-46b5-8419-5ee65f6da06c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:39.063848 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5897a5b5-d9c8-46b5-8419-5ee65f6da06c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:39.071758 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5897a5b5-d9c8-46b5-8419-5ee65f6da06c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:39.072200 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5897a5b5-d9c8-46b5-8419-5ee65f6da06c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:39.072991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5897a5b5-d9c8-46b5-8419-5ee65f6da06c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:39.073426 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5897a5b5-d9c8-46b5-8419-5ee65f6da06c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:39.199231 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-5897a5b5-d9c8-46b5-8419-5ee65f6da06c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:39.206514 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5897a5b5-d9c8-46b5-8419-5ee65f6da06c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.147004 Jun 30 17:55:39.207077 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 155/294] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:39 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:39.413908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-aa0f8ada-b931-4788-b264-8d11c03da531 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:39.414547 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-aa0f8ada-b931-4788-b264-8d11c03da531 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:39.421135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-aa0f8ada-b931-4788-b264-8d11c03da531 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:39.421582 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-aa0f8ada-b931-4788-b264-8d11c03da531 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:39.422347 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-aa0f8ada-b931-4788-b264-8d11c03da531 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:39.422782 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-aa0f8ada-b931-4788-b264-8d11c03da531 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:39.551801 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-aa0f8ada-b931-4788-b264-8d11c03da531 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:39.559171 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-aa0f8ada-b931-4788-b264-8d11c03da531 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.149021 Jun 30 17:55:39.559732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 140/295] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:39 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:40.223083 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9962c7eb-d3d2-43ea-a53b-e20b6de1e0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:40.223993 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-9962c7eb-d3d2-43ea-a53b-e20b6de1e0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:40.229703 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9962c7eb-d3d2-43ea-a53b-e20b6de1e0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:40.230147 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9962c7eb-d3d2-43ea-a53b-e20b6de1e0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:40.230931 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9962c7eb-d3d2-43ea-a53b-e20b6de1e0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:40.231363 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9962c7eb-d3d2-43ea-a53b-e20b6de1e0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:40.356829 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-9962c7eb-d3d2-43ea-a53b-e20b6de1e0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:40.364135 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-9962c7eb-d3d2-43ea-a53b-e20b6de1e0c4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.144977 Jun 30 17:55:40.364688 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 156/296] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:40 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:40.576000 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b7013013-85f6-4777-9855-1330259583ed tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:40.576609 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b7013013-85f6-4777-9855-1330259583ed tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:40.583148 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b7013013-85f6-4777-9855-1330259583ed tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:40.583596 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b7013013-85f6-4777-9855-1330259583ed tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:40.584348 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b7013013-85f6-4777-9855-1330259583ed tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:40.584782 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b7013013-85f6-4777-9855-1330259583ed tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:40.714210 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b7013013-85f6-4777-9855-1330259583ed tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:40.721559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b7013013-85f6-4777-9855-1330259583ed tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.149398 Jun 30 17:55:40.722119 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 141/297] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:40 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:41.380402 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-52869db8-8fae-4ede-bdf9-decdeda97117 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:41.380990 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-52869db8-8fae-4ede-bdf9-decdeda97117 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:41.387034 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-52869db8-8fae-4ede-bdf9-decdeda97117 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:41.387475 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-52869db8-8fae-4ede-bdf9-decdeda97117 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:41.388221 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-52869db8-8fae-4ede-bdf9-decdeda97117 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:41.388650 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-52869db8-8fae-4ede-bdf9-decdeda97117 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:41.520864 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-52869db8-8fae-4ede-bdf9-decdeda97117 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:41.528419 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-52869db8-8fae-4ede-bdf9-decdeda97117 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.151886 Jun 30 17:55:41.528972 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 157/298] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:41 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:41.737979 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-82105ae1-6b83-495d-83a0-76164a34839f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:41.738606 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-82105ae1-6b83-495d-83a0-76164a34839f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:41.745016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-82105ae1-6b83-495d-83a0-76164a34839f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:41.745465 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-82105ae1-6b83-495d-83a0-76164a34839f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:41.746209 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-82105ae1-6b83-495d-83a0-76164a34839f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:41.746669 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-82105ae1-6b83-495d-83a0-76164a34839f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:41.871267 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-82105ae1-6b83-495d-83a0-76164a34839f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:41.879041 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-82105ae1-6b83-495d-83a0-76164a34839f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.144887 Jun 30 17:55:41.879607 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 142/299] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:41 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:42.545437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9e3374cb-8df8-416c-91fb-dd02587233a8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:42.546036 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-9e3374cb-8df8-416c-91fb-dd02587233a8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:42.552060 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9e3374cb-8df8-416c-91fb-dd02587233a8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:42.552496 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9e3374cb-8df8-416c-91fb-dd02587233a8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:42.553232 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9e3374cb-8df8-416c-91fb-dd02587233a8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:42.553652 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9e3374cb-8df8-416c-91fb-dd02587233a8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:42.681621 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-9e3374cb-8df8-416c-91fb-dd02587233a8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:42.688932 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-9e3374cb-8df8-416c-91fb-dd02587233a8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.147306 Jun 30 17:55:42.689992 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 158/300] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:42 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:42.895751 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-822c7105-aa3f-4df3-886a-971caaec7e95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:42.896386 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-822c7105-aa3f-4df3-886a-971caaec7e95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:42.903164 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-822c7105-aa3f-4df3-886a-971caaec7e95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:42.903606 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-822c7105-aa3f-4df3-886a-971caaec7e95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:42.904469 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-822c7105-aa3f-4df3-886a-971caaec7e95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:42.904953 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-822c7105-aa3f-4df3-886a-971caaec7e95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:43.034879 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-822c7105-aa3f-4df3-886a-971caaec7e95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:43.042226 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-822c7105-aa3f-4df3-886a-971caaec7e95 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.150561 Jun 30 17:55:43.042866 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 143/301] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:42 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:43.707224 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-810a9823-1e7d-4c79-948e-a3754b8da6b1 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:43.707752 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-810a9823-1e7d-4c79-948e-a3754b8da6b1 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:43.713812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-810a9823-1e7d-4c79-948e-a3754b8da6b1 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:43.714247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-810a9823-1e7d-4c79-948e-a3754b8da6b1 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:43.715014 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-810a9823-1e7d-4c79-948e-a3754b8da6b1 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:43.715438 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-810a9823-1e7d-4c79-948e-a3754b8da6b1 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:43.847873 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-810a9823-1e7d-4c79-948e-a3754b8da6b1 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:43.855213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-810a9823-1e7d-4c79-948e-a3754b8da6b1 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.152343 Jun 30 17:55:43.855759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 159/302] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:43 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:44.059369 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3ab7a7f4-8795-4c8b-91e6-b4896cb6fdf4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:44.060009 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3ab7a7f4-8795-4c8b-91e6-b4896cb6fdf4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:44.067632 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3ab7a7f4-8795-4c8b-91e6-b4896cb6fdf4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:44.068077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3ab7a7f4-8795-4c8b-91e6-b4896cb6fdf4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:44.069058 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3ab7a7f4-8795-4c8b-91e6-b4896cb6fdf4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:44.069501 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3ab7a7f4-8795-4c8b-91e6-b4896cb6fdf4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:44.199815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3ab7a7f4-8795-4c8b-91e6-b4896cb6fdf4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:44.208503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3ab7a7f4-8795-4c8b-91e6-b4896cb6fdf4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.152992 Jun 30 17:55:44.209065 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 144/303] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:44 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:44.871778 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-006aa4ad-5c1b-4d1f-b30f-979bb89c70c2 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:44.872366 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-006aa4ad-5c1b-4d1f-b30f-979bb89c70c2 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:44.878361 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-006aa4ad-5c1b-4d1f-b30f-979bb89c70c2 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:44.878812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-006aa4ad-5c1b-4d1f-b30f-979bb89c70c2 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:44.879559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-006aa4ad-5c1b-4d1f-b30f-979bb89c70c2 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:44.879994 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-006aa4ad-5c1b-4d1f-b30f-979bb89c70c2 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:45.005635 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-006aa4ad-5c1b-4d1f-b30f-979bb89c70c2 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:45.012897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-006aa4ad-5c1b-4d1f-b30f-979bb89c70c2 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.145208 Jun 30 17:55:45.013446 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 160/304] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:44 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:45.225475 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-81ed8d6c-e34f-4aee-aa5a-402db982af6d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:45.226105 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-81ed8d6c-e34f-4aee-aa5a-402db982af6d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:45.232676 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-81ed8d6c-e34f-4aee-aa5a-402db982af6d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:45.233120 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-81ed8d6c-e34f-4aee-aa5a-402db982af6d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:45.233873 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-81ed8d6c-e34f-4aee-aa5a-402db982af6d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:45.234317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-81ed8d6c-e34f-4aee-aa5a-402db982af6d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:45.362068 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-81ed8d6c-e34f-4aee-aa5a-402db982af6d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:45.369399 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-81ed8d6c-e34f-4aee-aa5a-402db982af6d tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.148338 Jun 30 17:55:45.369979 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 145/305] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:45 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:46.030059 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-f8fe00dd-4088-4964-bc85-52abed6dd971 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:46.030685 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-f8fe00dd-4088-4964-bc85-52abed6dd971 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:46.036640 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f8fe00dd-4088-4964-bc85-52abed6dd971 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:46.037075 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f8fe00dd-4088-4964-bc85-52abed6dd971 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:46.037814 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f8fe00dd-4088-4964-bc85-52abed6dd971 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:46.038239 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f8fe00dd-4088-4964-bc85-52abed6dd971 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:46.167762 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-f8fe00dd-4088-4964-bc85-52abed6dd971 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:46.175872 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-f8fe00dd-4088-4964-bc85-52abed6dd971 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.149620 Jun 30 17:55:46.176424 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 161/306] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:46 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:46.386760 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b4c93c64-5a6a-4550-92fd-5e07ee24f908 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:46.387277 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b4c93c64-5a6a-4550-92fd-5e07ee24f908 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:46.393322 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b4c93c64-5a6a-4550-92fd-5e07ee24f908 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:46.393771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b4c93c64-5a6a-4550-92fd-5e07ee24f908 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:46.394562 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b4c93c64-5a6a-4550-92fd-5e07ee24f908 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:46.394997 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b4c93c64-5a6a-4550-92fd-5e07ee24f908 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:46.523671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b4c93c64-5a6a-4550-92fd-5e07ee24f908 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:46.531013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b4c93c64-5a6a-4550-92fd-5e07ee24f908 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.148349 Jun 30 17:55:46.531579 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 146/307] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:46 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:47.193326 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b5875718-fa52-45c3-9ed9-2afdb10eefae tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:47.193923 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b5875718-fa52-45c3-9ed9-2afdb10eefae tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:47.200166 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b5875718-fa52-45c3-9ed9-2afdb10eefae tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:47.200600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b5875718-fa52-45c3-9ed9-2afdb10eefae tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:47.201342 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b5875718-fa52-45c3-9ed9-2afdb10eefae tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:47.201766 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b5875718-fa52-45c3-9ed9-2afdb10eefae tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:47.331771 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b5875718-fa52-45c3-9ed9-2afdb10eefae tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:47.339175 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b5875718-fa52-45c3-9ed9-2afdb10eefae tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150354 Jun 30 17:55:47.339727 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 162/308] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:47 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:47.547627 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4769ac8d-6289-44af-abec-9a5e790dbcbf tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:47.548136 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4769ac8d-6289-44af-abec-9a5e790dbcbf tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:47.556472 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4769ac8d-6289-44af-abec-9a5e790dbcbf tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:47.556913 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4769ac8d-6289-44af-abec-9a5e790dbcbf tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:47.557669 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4769ac8d-6289-44af-abec-9a5e790dbcbf tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:47.558126 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4769ac8d-6289-44af-abec-9a5e790dbcbf tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:47.695405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4769ac8d-6289-44af-abec-9a5e790dbcbf tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:47.703008 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4769ac8d-6289-44af-abec-9a5e790dbcbf tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.159350 Jun 30 17:55:47.703567 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 147/309] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:47 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:48.355648 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b302e3b8-eb0a-4558-9289-12b9d6d181b7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:48.356285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b302e3b8-eb0a-4558-9289-12b9d6d181b7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:48.365572 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b302e3b8-eb0a-4558-9289-12b9d6d181b7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:48.366020 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b302e3b8-eb0a-4558-9289-12b9d6d181b7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:48.366805 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b302e3b8-eb0a-4558-9289-12b9d6d181b7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:48.367236 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b302e3b8-eb0a-4558-9289-12b9d6d181b7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:48.497992 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b302e3b8-eb0a-4558-9289-12b9d6d181b7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:48.505337 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b302e3b8-eb0a-4558-9289-12b9d6d181b7 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.153575 Jun 30 17:55:48.505897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 163/310] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:48 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:48.719912 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6b9ed3d4-fc39-48a4-879a-103a03fd0ad6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:48.720472 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6b9ed3d4-fc39-48a4-879a-103a03fd0ad6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:48.727599 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6b9ed3d4-fc39-48a4-879a-103a03fd0ad6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:48.728046 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6b9ed3d4-fc39-48a4-879a-103a03fd0ad6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:48.728797 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6b9ed3d4-fc39-48a4-879a-103a03fd0ad6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:48.729228 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6b9ed3d4-fc39-48a4-879a-103a03fd0ad6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:48.859184 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6b9ed3d4-fc39-48a4-879a-103a03fd0ad6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:48.866597 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6b9ed3d4-fc39-48a4-879a-103a03fd0ad6 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.150679 Jun 30 17:55:48.867161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 148/311] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:48 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:49.522457 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-614d1656-1c31-46fe-98f5-35920c5c1d76 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:49.523060 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-614d1656-1c31-46fe-98f5-35920c5c1d76 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:49.529052 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-614d1656-1c31-46fe-98f5-35920c5c1d76 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:49.529494 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-614d1656-1c31-46fe-98f5-35920c5c1d76 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:49.530247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-614d1656-1c31-46fe-98f5-35920c5c1d76 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:49.530701 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-614d1656-1c31-46fe-98f5-35920c5c1d76 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:49.534654 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=100 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:49.658792 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-614d1656-1c31-46fe-98f5-35920c5c1d76 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:49.666163 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-614d1656-1c31-46fe-98f5-35920c5c1d76 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.148001 Jun 30 17:55:49.666747 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 164/312] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:49 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:49.882946 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-e8f7968e-7c95-4e6b-908d-8c2783e40ee1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:49.883553 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-e8f7968e-7c95-4e6b-908d-8c2783e40ee1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:49.889908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e8f7968e-7c95-4e6b-908d-8c2783e40ee1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:49.890370 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e8f7968e-7c95-4e6b-908d-8c2783e40ee1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:49.891121 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e8f7968e-7c95-4e6b-908d-8c2783e40ee1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:49.891549 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e8f7968e-7c95-4e6b-908d-8c2783e40ee1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:49.910784 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=100 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:50.020813 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e8f7968e-7c95-4e6b-908d-8c2783e40ee1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:50.028315 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-e8f7968e-7c95-4e6b-908d-8c2783e40ee1 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.149250 Jun 30 17:55:50.028867 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 149/313] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:49 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:50.682879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-13ef78ca-a394-4477-9371-2bc67f9aadc8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:50.683508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-13ef78ca-a394-4477-9371-2bc67f9aadc8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:50.689886 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-13ef78ca-a394-4477-9371-2bc67f9aadc8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:50.690804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-13ef78ca-a394-4477-9371-2bc67f9aadc8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:50.691554 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-13ef78ca-a394-4477-9371-2bc67f9aadc8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:50.691986 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-13ef78ca-a394-4477-9371-2bc67f9aadc8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:50.819198 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-13ef78ca-a394-4477-9371-2bc67f9aadc8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:50.826853 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-13ef78ca-a394-4477-9371-2bc67f9aadc8 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.147809 Jun 30 17:55:50.827414 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 165/314] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:50 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:51.045900 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-8f70b369-17bd-4656-9048-bab19b304108 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:51.046537 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8f70b369-17bd-4656-9048-bab19b304108 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:51.053535 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8f70b369-17bd-4656-9048-bab19b304108 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:51.053986 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8f70b369-17bd-4656-9048-bab19b304108 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:51.054763 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8f70b369-17bd-4656-9048-bab19b304108 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:51.055195 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8f70b369-17bd-4656-9048-bab19b304108 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:51.183685 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-8f70b369-17bd-4656-9048-bab19b304108 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:51.191601 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-8f70b369-17bd-4656-9048-bab19b304108 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.149644 Jun 30 17:55:51.192156 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 150/315] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:51 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:51.844130 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-dd0f713d-dc5e-4643-a0ee-fce90ebccb14 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:51.844737 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-dd0f713d-dc5e-4643-a0ee-fce90ebccb14 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:51.851406 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dd0f713d-dc5e-4643-a0ee-fce90ebccb14 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:51.851851 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dd0f713d-dc5e-4643-a0ee-fce90ebccb14 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:51.852598 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dd0f713d-dc5e-4643-a0ee-fce90ebccb14 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:51.853027 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dd0f713d-dc5e-4643-a0ee-fce90ebccb14 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:51.982992 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-dd0f713d-dc5e-4643-a0ee-fce90ebccb14 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:51.990416 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-dd0f713d-dc5e-4643-a0ee-fce90ebccb14 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.150095 Jun 30 17:55:51.990971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 166/316] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:51 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:52.211870 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-e0433acb-ca9f-415d-92cc-19764ed6bde7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:52.212470 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-e0433acb-ca9f-415d-92cc-19764ed6bde7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:52.219017 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e0433acb-ca9f-415d-92cc-19764ed6bde7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:52.219455 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e0433acb-ca9f-415d-92cc-19764ed6bde7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:52.220195 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e0433acb-ca9f-415d-92cc-19764ed6bde7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:52.220621 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e0433acb-ca9f-415d-92cc-19764ed6bde7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:52.344564 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e0433acb-ca9f-415d-92cc-19764ed6bde7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:52.351859 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-e0433acb-ca9f-415d-92cc-19764ed6bde7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.143785 Jun 30 17:55:52.352417 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 151/317] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:52 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:53.006988 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e1a52695-ba10-4238-92bd-c67845e716e6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:53.007588 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e1a52695-ba10-4238-92bd-c67845e716e6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:53.013553 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e1a52695-ba10-4238-92bd-c67845e716e6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:53.013990 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e1a52695-ba10-4238-92bd-c67845e716e6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:53.014762 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e1a52695-ba10-4238-92bd-c67845e716e6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:53.015187 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e1a52695-ba10-4238-92bd-c67845e716e6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:53.139996 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e1a52695-ba10-4238-92bd-c67845e716e6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:53.147285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e1a52695-ba10-4238-92bd-c67845e716e6 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.144130 Jun 30 17:55:53.147838 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 167/318] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:53 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:55:53.367907 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-9ca53212-98cb-45f3-bf16-f02c551a8a53 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:53.368515 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-9ca53212-98cb-45f3-bf16-f02c551a8a53 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:53.375032 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9ca53212-98cb-45f3-bf16-f02c551a8a53 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:53.375481 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9ca53212-98cb-45f3-bf16-f02c551a8a53 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:53.376235 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9ca53212-98cb-45f3-bf16-f02c551a8a53 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:53.376675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9ca53212-98cb-45f3-bf16-f02c551a8a53 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:53.505868 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-9ca53212-98cb-45f3-bf16-f02c551a8a53 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:53.513200 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-9ca53212-98cb-45f3-bf16-f02c551a8a53 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.149112 Jun 30 17:55:53.513767 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 152/319] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:53 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:54.164119 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e243eb52-ed4d-4009-bad0-14e8a3ea8445 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:54.164752 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e243eb52-ed4d-4009-bad0-14e8a3ea8445 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:54.170765 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e243eb52-ed4d-4009-bad0-14e8a3ea8445 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:54.171207 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e243eb52-ed4d-4009-bad0-14e8a3ea8445 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:54.171951 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e243eb52-ed4d-4009-bad0-14e8a3ea8445 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:54.172382 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e243eb52-ed4d-4009-bad0-14e8a3ea8445 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:54.298722 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e243eb52-ed4d-4009-bad0-14e8a3ea8445 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:54.306482 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e243eb52-ed4d-4009-bad0-14e8a3ea8445 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.146150 Jun 30 17:55:54.307038 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 168/320] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:54 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:54.529710 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d1c343cb-1c6e-4215-97d1-05385bfb4914 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:54.530230 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d1c343cb-1c6e-4215-97d1-05385bfb4914 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:54.532555 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=52 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:54.539948 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d1c343cb-1c6e-4215-97d1-05385bfb4914 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:54.540389 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d1c343cb-1c6e-4215-97d1-05385bfb4914 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:54.541143 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d1c343cb-1c6e-4215-97d1-05385bfb4914 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:54.541575 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d1c343cb-1c6e-4215-97d1-05385bfb4914 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:54.669759 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d1c343cb-1c6e-4215-97d1-05385bfb4914 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:54.677787 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d1c343cb-1c6e-4215-97d1-05385bfb4914 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.152054 Jun 30 17:55:54.678359 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 153/321] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:54 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:55.324053 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5fc189e7-df43-4f07-beaf-bc1d4e104264 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:55.324709 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5fc189e7-df43-4f07-beaf-bc1d4e104264 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:55.331374 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5fc189e7-df43-4f07-beaf-bc1d4e104264 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:55.331761 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5fc189e7-df43-4f07-beaf-bc1d4e104264 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:55.332508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5fc189e7-df43-4f07-beaf-bc1d4e104264 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:55.332938 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5fc189e7-df43-4f07-beaf-bc1d4e104264 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:55.460515 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-5fc189e7-df43-4f07-beaf-bc1d4e104264 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:55.467913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5fc189e7-df43-4f07-beaf-bc1d4e104264 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.147992 Jun 30 17:55:55.468467 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 169/322] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:55 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:55.694529 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4b35e076-63da-4326-8ca0-7a7f32baac02 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:55.695170 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4b35e076-63da-4326-8ca0-7a7f32baac02 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:55.701992 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4b35e076-63da-4326-8ca0-7a7f32baac02 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:55.702468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4b35e076-63da-4326-8ca0-7a7f32baac02 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:55.703231 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4b35e076-63da-4326-8ca0-7a7f32baac02 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:55.703666 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4b35e076-63da-4326-8ca0-7a7f32baac02 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:55.832103 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4b35e076-63da-4326-8ca0-7a7f32baac02 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:55.839585 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4b35e076-63da-4326-8ca0-7a7f32baac02 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.148837 Jun 30 17:55:55.840455 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 154/323] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:55 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:56.233847 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-61ad9a04-e00f-457a-a6b5-febc64e72f9c req-88663b09-fefb-45a1-bedd-8e8b151f5ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c800e3f-1e79-43c4-8013-a39d55cf9749", "tag": "4dfdbd60-095f-4a21-9462-858c1e0777b8"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:55:56.243107 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-61ad9a04-e00f-457a-a6b5-febc64e72f9c req-88663b09-fefb-45a1-bedd-8e8b151f5ca4 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:56.243613 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-61ad9a04-e00f-457a-a6b5-febc64e72f9c req-88663b09-fefb-45a1-bedd-8e8b151f5ca4 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:56.261569 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-61ad9a04-e00f-457a-a6b5-febc64e72f9c req-88663b09-fefb-45a1-bedd-8e8b151f5ca4 service nova] Creating event network-changed:4dfdbd60-095f-4a21-9462-858c1e0777b8 for instance 2c800e3f-1e79-43c4-8013-a39d55cf9749 on hv-cinder-81268 Jun 30 17:55:56.266967 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-61ad9a04-e00f-457a-a6b5-febc64e72f9c req-88663b09-fefb-45a1-bedd-8e8b151f5ca4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036858 Jun 30 17:55:56.267572 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 170/324] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:55:56.484484 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b401f7fb-4baf-4f20-831d-e0e17696e97f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:56.485025 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b401f7fb-4baf-4f20-831d-e0e17696e97f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:56.492943 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b401f7fb-4baf-4f20-831d-e0e17696e97f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:56.493396 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b401f7fb-4baf-4f20-831d-e0e17696e97f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:56.494155 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b401f7fb-4baf-4f20-831d-e0e17696e97f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:56.494622 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b401f7fb-4baf-4f20-831d-e0e17696e97f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:56.725092 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b401f7fb-4baf-4f20-831d-e0e17696e97f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:56.734461 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b401f7fb-4baf-4f20-831d-e0e17696e97f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1322 microversion: 2.1 time: 0.253790 Jun 30 17:55:56.747331 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 155/325] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:56 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:56.857671 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d8d76757-6768-4b82-91e0-6f4600001289 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:56.858363 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-d8d76757-6768-4b82-91e0-6f4600001289 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:56.862317 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=54 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:56.867095 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d8d76757-6768-4b82-91e0-6f4600001289 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:56.867625 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d8d76757-6768-4b82-91e0-6f4600001289 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:56.868454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d8d76757-6768-4b82-91e0-6f4600001289 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:56.869078 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d8d76757-6768-4b82-91e0-6f4600001289 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:57.000344 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-d8d76757-6768-4b82-91e0-6f4600001289 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:57.007824 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d8d76757-6768-4b82-91e0-6f4600001289 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.154671 Jun 30 17:55:57.008377 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 171/326] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:56 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:57.751532 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2eaf54ab-bfb7-485d-bc94-6d08f6704e8b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:57.752135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2eaf54ab-bfb7-485d-bc94-6d08f6704e8b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:57.759155 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2eaf54ab-bfb7-485d-bc94-6d08f6704e8b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:57.759602 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2eaf54ab-bfb7-485d-bc94-6d08f6704e8b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:57.760355 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2eaf54ab-bfb7-485d-bc94-6d08f6704e8b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:57.760789 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2eaf54ab-bfb7-485d-bc94-6d08f6704e8b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:57.930989 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2eaf54ab-bfb7-485d-bc94-6d08f6704e8b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:57.939499 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2eaf54ab-bfb7-485d-bc94-6d08f6704e8b tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1266 microversion: 2.1 time: 0.191628 Jun 30 17:55:57.939972 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 156/327] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:57 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:58.025299 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-faffacb5-3028-4686-8dd5-3ae323e50190 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:58.026673 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-faffacb5-3028-4686-8dd5-3ae323e50190 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:58.034646 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-faffacb5-3028-4686-8dd5-3ae323e50190 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:58.036150 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-faffacb5-3028-4686-8dd5-3ae323e50190 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:58.036577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-faffacb5-3028-4686-8dd5-3ae323e50190 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:58.037009 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-faffacb5-3028-4686-8dd5-3ae323e50190 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:58.276361 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-faffacb5-3028-4686-8dd5-3ae323e50190 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:58.289399 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-faffacb5-3028-4686-8dd5-3ae323e50190 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.263386 Jun 30 17:55:58.291603 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 172/328] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:58 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:58.536051 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-272be581-70d4-4520-a367-5c29de9cb3d9 req-7996b585-29c3-42c5-80ff-81e1591c31a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6809d58d-8edd-4bc0-b068-4a278f6fc37d", "name": "network-vif-deleted", "tag": "3d94c499-5b2c-4ec8-bc2c-db39e0936d8b"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:55:58.544369 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-272be581-70d4-4520-a367-5c29de9cb3d9 req-7996b585-29c3-42c5-80ff-81e1591c31a8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:58.545097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-272be581-70d4-4520-a367-5c29de9cb3d9 req-7996b585-29c3-42c5-80ff-81e1591c31a8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:58.560888 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.compute.server_external_events [req-272be581-70d4-4520-a367-5c29de9cb3d9 req-7996b585-29c3-42c5-80ff-81e1591c31a8 service nova] Unable to find a host for instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d. Dropping event network-vif-deleted {{(pid=129371) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 17:55:58.561788 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-272be581-70d4-4520-a367-5c29de9cb3d9 req-7996b585-29c3-42c5-80ff-81e1591c31a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.030040 Jun 30 17:55:58.562392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 157/329] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 30 17:55:58.955825 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:58.956532 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:58.962620 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:58.963063 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:58.963810 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:58.964235 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:58.994911 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:58.995349 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:58.995785 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.objects.instance [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lazy-loading 'fault' on Instance uuid 6809d58d-8edd-4bc0-b068-4a278f6fc37d {{(pid=129370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 17:55:59.034881 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:59.041956 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8f00245d-8392-41c9-8ce9-57d9aa52c60f tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 200 len: 1386 microversion: 2.1 time: 0.090042 Jun 30 17:55:59.042534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 173/330] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:58 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 1386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:59.058202 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:59.058761 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:59.065217 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.065665 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.066446 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.066883 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.091330 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 17:55:59.142556 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Doing local delete in cell 971563eb-4a0b-4a3d-98cf-496d4678315e(cell1) {{(pid=129371) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 30 17:55:59.143360 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.143803 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.144507 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: WARNING nova.compute.api [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] instance's host None is down, deleting from database Jun 30 17:55:59.149056 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] deallocate_for_instance() {{(pid=129371) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 30 17:55:59.182540 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Instance cache missing network info. {{(pid=129371) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3303}} Jun 30 17:55:59.192507 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Updating instance_info_cache with network_info: [] {{(pid=129371) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 30 17:55:59.300692 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7131123f-5926-49e9-becc-46e535d2bccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:59.301293 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-7131123f-5926-49e9-becc-46e535d2bccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:59.309557 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7131123f-5926-49e9-becc-46e535d2bccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.310001 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7131123f-5926-49e9-becc-46e535d2bccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.313963 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7131123f-5926-49e9-becc-46e535d2bccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.314618 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7131123f-5926-49e9-becc-46e535d2bccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.408148 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.scheduler.client.report [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Deleted allocations for instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d Jun 30 17:55:59.449073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-7131123f-5926-49e9-becc-46e535d2bccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:59.456640 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-7131123f-5926-49e9-becc-46e535d2bccd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.159694 Jun 30 17:55:59.457285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 174/331] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:59 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:55:59.548177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-fb926a6a-7b8f-455d-8019-d63dbbaf78a5 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 204 len: 0 microversion: 2.1 time: 0.493795 Jun 30 17:55:59.552069 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 158/332] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 17:55:59 2022] DELETE /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 17:55:59.561419 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:59.561419 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: 6809d58d-8edd-4bc0-b068-4a278f6fc37d] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:59.564161 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.565243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.566012 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.566481 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.579883 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] HTTP exception thrown: Instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d could not be found. Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Request method failure captured: Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d HTTP/1.1 Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveNPT0IzGCdo5Ey5mJlb28YxzkwOXWvCFP3h9wkVyAlNSh0kbUTn5VTM8Tc2I5UjAvRp7LjP-2CsGhqH61RyApBgiKeCW6nGwies95L-K_CRY6oeSSNrA9WAnlKwc6zAEDdKqujyYCsw7ZniOg9AEakO1zkeLhMZFNn0RvRjO-ZWYqA Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 1dc70bdf33a44324a55e8a894a7340ee Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1316751924 Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 17:55:59.581524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dc70bdf33a44324a55e8a894a7340ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dc70bdf33a44324a55e8a894a7340ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dc70bdf33a44324a55e8a894a7340ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dc70bdf33a44324a55e8a894a7340ee"}]}] Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1316751924 Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 1dc70bdf33a44324a55e8a894a7340ee Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1316751924 Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-ServerRescueNegativeTestJSON-1316751924-project Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: e031883951b8486581e198cf6c9705b8 Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1316751924-project Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d could not be found. Jun 30 17:55:59.583196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '6809d58d-8edd-4bc0-b068-4a278f6fc37d'} Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d could not be found. Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:55:59.584089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d could not be found. Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d could not be found. Jun 30 17:55:59.585559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 17:55:59.586770 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Returning 404 to user: Instance 6809d58d-8edd-4bc0-b068-4a278f6fc37d could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:55:59.586770 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e94971fe-b868-4d8b-a505-47f5c2782b87 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d" status: 404 len: 111 microversion: 2.1 time: 0.029628 Jun 30 17:55:59.586770 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 175/333] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:59 2022] GET /compute/v2.1/servers/6809d58d-8edd-4bc0-b068-4a278f6fc37d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:55:59.592279 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3fff4e2f-645b-4166-b74d-d38ceeeb143c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:59.592862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3fff4e2f-645b-4166-b74d-d38ceeeb143c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: e96946d3-6552-4429-8bce-a4d9f8ac9318] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:59.598942 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3fff4e2f-645b-4166-b74d-d38ceeeb143c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.599391 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3fff4e2f-645b-4166-b74d-d38ceeeb143c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.600145 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3fff4e2f-645b-4166-b74d-d38ceeeb143c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.600581 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3fff4e2f-645b-4166-b74d-d38ceeeb143c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.625638 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3fff4e2f-645b-4166-b74d-d38ceeeb143c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: e96946d3-6552-4429-8bce-a4d9f8ac9318] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 17:55:59.657703 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:55:59.703577 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3fff4e2f-645b-4166-b74d-d38ceeeb143c tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318" status: 204 len: 0 microversion: 2.1 time: 0.115305 Jun 30 17:55:59.704142 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 159/334] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 17:55:59 2022] DELETE /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 17:55:59.712102 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-61e15c68-fbb7-4b0b-a645-f4f8e164d0b4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:55:59.712737 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-61e15c68-fbb7-4b0b-a645-f4f8e164d0b4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: e96946d3-6552-4429-8bce-a4d9f8ac9318] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:55:59.718665 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-61e15c68-fbb7-4b0b-a645-f4f8e164d0b4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.719113 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-61e15c68-fbb7-4b0b-a645-f4f8e164d0b4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.719865 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-61e15c68-fbb7-4b0b-a645-f4f8e164d0b4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:55:59.720296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-61e15c68-fbb7-4b0b-a645-f4f8e164d0b4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:55:59.849615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-61e15c68-fbb7-4b0b-a645-f4f8e164d0b4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:55:59.857132 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-61e15c68-fbb7-4b0b-a645-f4f8e164d0b4 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318" status: 200 len: 1521 microversion: 2.1 time: 0.148878 Jun 30 17:55:59.857681 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 176/335] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:55:59 2022] GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:00.474979 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-18eaae20-0473-4c6e-884b-ba43d49ca23f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:00.475735 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-18eaae20-0473-4c6e-884b-ba43d49ca23f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:00.482874 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-18eaae20-0473-4c6e-884b-ba43d49ca23f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:00.483312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-18eaae20-0473-4c6e-884b-ba43d49ca23f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:00.484067 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-18eaae20-0473-4c6e-884b-ba43d49ca23f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:00.484494 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-18eaae20-0473-4c6e-884b-ba43d49ca23f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:00.632454 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-18eaae20-0473-4c6e-884b-ba43d49ca23f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:00.640003 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-18eaae20-0473-4c6e-884b-ba43d49ca23f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.169919 Jun 30 17:56:00.640568 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 160/336] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:00 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:00.875433 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-0306fc71-6f76-4153-badb-8ec5be56813a tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:00.875988 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-0306fc71-6f76-4153-badb-8ec5be56813a tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: e96946d3-6552-4429-8bce-a4d9f8ac9318] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:00.882042 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0306fc71-6f76-4153-badb-8ec5be56813a tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:00.882520 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0306fc71-6f76-4153-badb-8ec5be56813a tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:00.883269 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0306fc71-6f76-4153-badb-8ec5be56813a tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:00.883697 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0306fc71-6f76-4153-badb-8ec5be56813a tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:01.021303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-0306fc71-6f76-4153-badb-8ec5be56813a tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:01.028683 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-0306fc71-6f76-4153-badb-8ec5be56813a tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318" status: 200 len: 1521 microversion: 2.1 time: 0.157308 Jun 30 17:56:01.029272 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 177/337] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:00 2022] GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:01.656024 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7803394a-2acd-4d8e-b1c8-5ca2830afe1b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:01.656566 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7803394a-2acd-4d8e-b1c8-5ca2830afe1b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:01.663770 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7803394a-2acd-4d8e-b1c8-5ca2830afe1b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:01.664211 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7803394a-2acd-4d8e-b1c8-5ca2830afe1b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:01.664958 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7803394a-2acd-4d8e-b1c8-5ca2830afe1b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:01.665385 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7803394a-2acd-4d8e-b1c8-5ca2830afe1b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:01.788973 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7803394a-2acd-4d8e-b1c8-5ca2830afe1b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:01.796349 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7803394a-2acd-4d8e-b1c8-5ca2830afe1b tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.144153 Jun 30 17:56:01.796904 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 161/338] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:01 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:02.046994 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d39c1498-6b8c-490d-b86c-7c654c90c449 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:02.047599 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-d39c1498-6b8c-490d-b86c-7c654c90c449 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: e96946d3-6552-4429-8bce-a4d9f8ac9318] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:02.053533 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d39c1498-6b8c-490d-b86c-7c654c90c449 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:02.053977 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d39c1498-6b8c-490d-b86c-7c654c90c449 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:02.054760 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d39c1498-6b8c-490d-b86c-7c654c90c449 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:02.055194 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d39c1498-6b8c-490d-b86c-7c654c90c449 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:02.185502 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-d39c1498-6b8c-490d-b86c-7c654c90c449 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:02.194634 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d39c1498-6b8c-490d-b86c-7c654c90c449 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318" status: 200 len: 1521 microversion: 2.1 time: 0.151428 Jun 30 17:56:02.195187 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 178/339] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:02 2022] GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:02.813250 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-9ed2b987-ce2f-44b4-8b45-d64afaf647dd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:02.813856 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-9ed2b987-ce2f-44b4-8b45-d64afaf647dd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:02.820978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9ed2b987-ce2f-44b4-8b45-d64afaf647dd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:02.821418 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9ed2b987-ce2f-44b4-8b45-d64afaf647dd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:02.822164 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9ed2b987-ce2f-44b4-8b45-d64afaf647dd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:02.822624 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9ed2b987-ce2f-44b4-8b45-d64afaf647dd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:02.952053 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-9ed2b987-ce2f-44b4-8b45-d64afaf647dd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:02.959449 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-9ed2b987-ce2f-44b4-8b45-d64afaf647dd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.150390 Jun 30 17:56:02.960007 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 162/340] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:02 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:03.212194 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8047f8d9-b9bf-43b1-a95f-9f93536148ef tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:03.212730 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8047f8d9-b9bf-43b1-a95f-9f93536148ef tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: e96946d3-6552-4429-8bce-a4d9f8ac9318] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:03.218757 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8047f8d9-b9bf-43b1-a95f-9f93536148ef tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:03.219204 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8047f8d9-b9bf-43b1-a95f-9f93536148ef tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:03.219956 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8047f8d9-b9bf-43b1-a95f-9f93536148ef tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:03.220387 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8047f8d9-b9bf-43b1-a95f-9f93536148ef tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:03.349809 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8047f8d9-b9bf-43b1-a95f-9f93536148ef tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e031883951b8486581e198cf6c9705b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dc70bdf33a44324a55e8a894a7340ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:03.357148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8047f8d9-b9bf-43b1-a95f-9f93536148ef tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318" status: 200 len: 1521 microversion: 2.1 time: 0.148844 Jun 30 17:56:03.357712 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 179/341] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:03 2022] GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:03.610753 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-725a998d-f2f1-4110-877d-1b77346b456d req-74d815c4-8401-458b-aec5-af81f113a636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e96946d3-6552-4429-8bce-a4d9f8ac9318", "name": "network-vif-deleted", "tag": "3a07ee47-30bf-4df5-9e2b-7714125bc765"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:56:03.619474 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-725a998d-f2f1-4110-877d-1b77346b456d req-74d815c4-8401-458b-aec5-af81f113a636 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:03.619917 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-725a998d-f2f1-4110-877d-1b77346b456d req-74d815c4-8401-458b-aec5-af81f113a636 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:03.634856 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-725a998d-f2f1-4110-877d-1b77346b456d req-74d815c4-8401-458b-aec5-af81f113a636 service nova] Creating event network-vif-deleted:3a07ee47-30bf-4df5-9e2b-7714125bc765 for instance e96946d3-6552-4429-8bce-a4d9f8ac9318 on hv-cinder-81268 Jun 30 17:56:03.644704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-725a998d-f2f1-4110-877d-1b77346b456d req-74d815c4-8401-458b-aec5-af81f113a636 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037522 Jun 30 17:56:03.645305 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 163/342] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:56:03.976172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-77ba6f0e-c9c1-42ca-b999-a3903be0afe4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:03.976736 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-77ba6f0e-c9c1-42ca-b999-a3903be0afe4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:03.982828 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-77ba6f0e-c9c1-42ca-b999-a3903be0afe4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:03.983264 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-77ba6f0e-c9c1-42ca-b999-a3903be0afe4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:03.984003 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-77ba6f0e-c9c1-42ca-b999-a3903be0afe4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:03.984426 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-77ba6f0e-c9c1-42ca-b999-a3903be0afe4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:04.113790 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-77ba6f0e-c9c1-42ca-b999-a3903be0afe4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:04.132300 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-77ba6f0e-c9c1-42ca-b999-a3903be0afe4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.150141 Jun 30 17:56:04.132300 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 180/343] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:03 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:04.375706 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:04.376401 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] [instance: e96946d3-6552-4429-8bce-a4d9f8ac9318] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:04.382981 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:04.383429 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:04.384184 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:04.384616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:04.397752 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] HTTP exception thrown: Instance e96946d3-6552-4429-8bce-a4d9f8ac9318 could not be found. Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Request method failure captured: Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318 HTTP/1.1 Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveNPT0IzGCdo5Ey5mJlb28YxzkwOXWvCFP3h9wkVyAlNSh0kbUTn5VTM8Tc2I5UjAvRp7LjP-2CsGhqH61RyApBgiKeCW6nGwies95L-K_CRY6oeSSNrA9WAnlKwc6zAEDdKqujyYCsw7ZniOg9AEakO1zkeLhMZFNn0RvRjO-ZWYqA Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 1dc70bdf33a44324a55e8a894a7340ee Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1316751924 Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 17:56:04.399371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1dc70bdf33a44324a55e8a894a7340ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1dc70bdf33a44324a55e8a894a7340ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dc70bdf33a44324a55e8a894a7340ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1dc70bdf33a44324a55e8a894a7340ee"}]}] Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1316751924 Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 1dc70bdf33a44324a55e8a894a7340ee Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1316751924 Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-ServerRescueNegativeTestJSON-1316751924-project Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: e031883951b8486581e198cf6c9705b8 Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1316751924-project Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance e96946d3-6552-4429-8bce-a4d9f8ac9318 could not be found. Jun 30 17:56:04.400852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': 'e96946d3-6552-4429-8bce-a4d9f8ac9318'} Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e96946d3-6552-4429-8bce-a4d9f8ac9318 could not be found. Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 17:56:04.401675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e96946d3-6552-4429-8bce-a4d9f8ac9318 could not be found. Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e96946d3-6552-4429-8bce-a4d9f8ac9318 could not be found. Jun 30 17:56:04.403052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 17:56:04.404354 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] Returning 404 to user: Instance e96946d3-6552-4429-8bce-a4d9f8ac9318 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 17:56:04.404354 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-14b9f035-ebd3-46cd-8553-d45cdc352414 tempest-ServerRescueNegativeTestJSON-1316751924 tempest-ServerRescueNegativeTestJSON-1316751924-project] 10.222.0.16 "GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318" status: 404 len: 111 microversion: 2.1 time: 0.029207 Jun 30 17:56:04.404354 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 164/344] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:04 2022] GET /compute/v2.1/servers/e96946d3-6552-4429-8bce-a4d9f8ac9318 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 17:56:05.139998 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-23df588c-28c0-4b61-9012-772350ac0f63 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:05.140830 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-23df588c-28c0-4b61-9012-772350ac0f63 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:05.147652 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23df588c-28c0-4b61-9012-772350ac0f63 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:05.148097 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23df588c-28c0-4b61-9012-772350ac0f63 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:05.148849 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23df588c-28c0-4b61-9012-772350ac0f63 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:05.149272 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23df588c-28c0-4b61-9012-772350ac0f63 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:05.297675 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-23df588c-28c0-4b61-9012-772350ac0f63 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:05.301703 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=100 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:05.306710 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-23df588c-28c0-4b61-9012-772350ac0f63 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.170899 Jun 30 17:56:05.307277 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 181/345] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:05 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:05.730685 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-2148788a-46cb-494d-9308-3a6a8764ce34 req-c324e931-761d-4f2b-9a3b-cfd4866c4e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c800e3f-1e79-43c4-8013-a39d55cf9749", "name": "network-vif-plugged", "status": "completed", "tag": "4dfdbd60-095f-4a21-9462-858c1e0777b8"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:56:05.742177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-2148788a-46cb-494d-9308-3a6a8764ce34 req-c324e931-761d-4f2b-9a3b-cfd4866c4e1c service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:05.742772 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-2148788a-46cb-494d-9308-3a6a8764ce34 req-c324e931-761d-4f2b-9a3b-cfd4866c4e1c service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:05.754787 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-2148788a-46cb-494d-9308-3a6a8764ce34 req-c324e931-761d-4f2b-9a3b-cfd4866c4e1c service nova] Creating event network-vif-plugged:4dfdbd60-095f-4a21-9462-858c1e0777b8 for instance 2c800e3f-1e79-43c4-8013-a39d55cf9749 on hv-cinder-81268 Jun 30 17:56:05.759844 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-2148788a-46cb-494d-9308-3a6a8764ce34 req-c324e931-761d-4f2b-9a3b-cfd4866c4e1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032914 Jun 30 17:56:05.760590 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 165/346] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:56:06.324338 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e84ac7c1-ce89-4b05-b2ab-8454ed8787a7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:06.325584 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e84ac7c1-ce89-4b05-b2ab-8454ed8787a7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:06.332126 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e84ac7c1-ce89-4b05-b2ab-8454ed8787a7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:06.332810 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e84ac7c1-ce89-4b05-b2ab-8454ed8787a7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:06.333571 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e84ac7c1-ce89-4b05-b2ab-8454ed8787a7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:06.334008 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e84ac7c1-ce89-4b05-b2ab-8454ed8787a7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:06.475670 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e84ac7c1-ce89-4b05-b2ab-8454ed8787a7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:06.483771 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e84ac7c1-ce89-4b05-b2ab-8454ed8787a7 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.163669 Jun 30 17:56:06.484328 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 182/347] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:06 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:07.501277 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0fed44df-3c30-4a65-a5ba-fcbf21400666 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:07.501970 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0fed44df-3c30-4a65-a5ba-fcbf21400666 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:07.511269 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fed44df-3c30-4a65-a5ba-fcbf21400666 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:07.511888 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fed44df-3c30-4a65-a5ba-fcbf21400666 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:07.512824 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fed44df-3c30-4a65-a5ba-fcbf21400666 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:07.513417 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fed44df-3c30-4a65-a5ba-fcbf21400666 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:07.777145 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0fed44df-3c30-4a65-a5ba-fcbf21400666 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:07.787423 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0fed44df-3c30-4a65-a5ba-fcbf21400666 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1358 microversion: 2.1 time: 0.290255 Jun 30 17:56:07.787927 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 166/348] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:07 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:08.804291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6760d842-b8a0-45f7-8496-f3daa15f4e74 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:08.805049 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6760d842-b8a0-45f7-8496-f3daa15f4e74 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:08.811139 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6760d842-b8a0-45f7-8496-f3daa15f4e74 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:08.811649 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6760d842-b8a0-45f7-8496-f3daa15f4e74 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:08.812426 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6760d842-b8a0-45f7-8496-f3daa15f4e74 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:08.812861 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6760d842-b8a0-45f7-8496-f3daa15f4e74 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:08.945721 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6760d842-b8a0-45f7-8496-f3daa15f4e74 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:08.953150 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6760d842-b8a0-45f7-8496-f3daa15f4e74 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1549 microversion: 2.1 time: 0.152734 Jun 30 17:56:08.953732 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 183/349] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:08 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:08.970138 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4e3f7e05-f834-4f08-b4c7-d0ca433c5bdd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:08.971595 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4e3f7e05-f834-4f08-b4c7-d0ca433c5bdd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:08.979089 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e3f7e05-f834-4f08-b4c7-d0ca433c5bdd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:08.979685 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e3f7e05-f834-4f08-b4c7-d0ca433c5bdd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:08.980714 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e3f7e05-f834-4f08-b4c7-d0ca433c5bdd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:08.981368 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4e3f7e05-f834-4f08-b4c7-d0ca433c5bdd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:09.207476 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4e3f7e05-f834-4f08-b4c7-d0ca433c5bdd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:09.214998 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4e3f7e05-f834-4f08-b4c7-d0ca433c5bdd tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1549 microversion: 2.1 time: 0.248876 Jun 30 17:56:09.215652 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 167/350] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:08 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1549 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:09.231978 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-42281510-3fe9-4774-ab3e-71b96e66964c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:09.235459 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-42281510-3fe9-4774-ab3e-71b96e66964c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:09.236319 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-42281510-3fe9-4774-ab3e-71b96e66964c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Searching by: {'deleted': False, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11'} {{(pid=129370) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 30 17:56:09.243020 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42281510-3fe9-4774-ab3e-71b96e66964c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:09.243463 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42281510-3fe9-4774-ab3e-71b96e66964c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:09.244253 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42281510-3fe9-4774-ab3e-71b96e66964c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:09.244684 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42281510-3fe9-4774-ab3e-71b96e66964c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:09.341698 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.multi_cell_list [None req-42281510-3fe9-4774-ab3e-71b96e66964c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129370) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 30 17:56:09.588439 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-42281510-3fe9-4774-ab3e-71b96e66964c tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.360294 Jun 30 17:56:09.594714 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 184/351] 10.222.0.16 () {58 vars in 1124 bytes} [Thu Jun 30 17:56:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:56:09.601180 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-e520dd7e-055a-496d-91fb-3811db1b4671 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:09.602090 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-e520dd7e-055a-496d-91fb-3811db1b4671 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:09.609062 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e520dd7e-055a-496d-91fb-3811db1b4671 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:09.609758 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e520dd7e-055a-496d-91fb-3811db1b4671 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:09.610652 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e520dd7e-055a-496d-91fb-3811db1b4671 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:09.611219 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e520dd7e-055a-496d-91fb-3811db1b4671 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:09.757536 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e520dd7e-055a-496d-91fb-3811db1b4671 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:09.766150 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-e520dd7e-055a-496d-91fb-3811db1b4671 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1549 microversion: 2.1 time: 0.169101 Jun 30 17:56:09.766759 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 168/352] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:09 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:13.218003 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b0245114-00de-4fb7-83f0-0c0f64e1b2ee tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Action: 'create', calling method: .version_select at 0x7f8f3c3f4280>, body: {"keypair": {"name": "tempest-keypair-4136570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCjLC0GFd1xmA0SXahsVeRxfx51vvVs0AllCEBvY/4aMXvB9uOvUmVxPxcj+KepIGn0yabU9I8nUPyMkRYikq2+rfseZ4cvsqv5SGeoKHiLaSdgMRh6k4vyXKdELnRXrw=="}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:56:13.233485 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-b0245114-00de-4fb7-83f0-0c0f64e1b2ee tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Getting quotas for project 221481e35182443995ea17136383f6f4. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:56:13.237462 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-b0245114-00de-4fb7-83f0-0c0f64e1b2ee tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Getting quotas for user de0ef30352514ef9bb4559473e096ea6 and project 221481e35182443995ea17136383f6f4. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:56:13.249454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0245114-00de-4fb7-83f0-0c0f64e1b2ee tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [5879624f-f361-49b3-80c1-aece9d50d4ee] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 17:56:14.256199 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0245114-00de-4fb7-83f0-0c0f64e1b2ee tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [5879624f-f361-49b3-80c1-aece9d50d4ee] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43424. Jun 30 17:56:14.273748 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b0245114-00de-4fb7-83f0-0c0f64e1b2ee tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 1.206800 Jun 30 17:56:14.275037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 185/353] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 17:56:13 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:56:15.924714 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-230250146", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a4b8b46-fc60-41bc-90ea-26f4138eda22"}], "security_groups": [{"name": "tempest-securitygroup--2110744284"}], "key_name": "tempest-keypair-4136570", "user_data": "}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:56:16.033782 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] validate_networks() for [('5a4b8b46-fc60-41bc-90ea-26f4138eda22', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 17:56:16.438971 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 17:56:16.439390 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 17:56:16.439905 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 17:56:16.440319 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 17:56:16.440727 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 17:56:16.450043 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:16.450522 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:16.451317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:16.451741 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:16.470752 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Getting quotas for project 221481e35182443995ea17136383f6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 17:56:16.474776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Getting quotas for user de0ef30352514ef9bb4559473e096ea6 and project 221481e35182443995ea17136383f6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 17:56:16.493090 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 17:56:16.496899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 17:56:16.545812 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-cce4c0ad-7816-416a-9825-afb2945da726 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.625877 Jun 30 17:56:16.550594 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 169/354] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 17:56:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 17:56:16.556964 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-21ab18d8-fe7d-458d-bc86-e0daef020cd6 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:16.557595 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-21ab18d8-fe7d-458d-bc86-e0daef020cd6 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:16.615053 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-21ab18d8-fe7d-458d-bc86-e0daef020cd6 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:16.622649 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-21ab18d8-fe7d-458d-bc86-e0daef020cd6 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1234 microversion: 2.1 time: 0.069795 Jun 30 17:56:16.623220 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 186/355] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:16 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1234 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:17.640394 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-fe7dccae-91ac-4893-9ff4-f6a1d23e935f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:17.641006 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-fe7dccae-91ac-4893-9ff4-f6a1d23e935f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:17.648932 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fe7dccae-91ac-4893-9ff4-f6a1d23e935f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:17.649689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fe7dccae-91ac-4893-9ff4-f6a1d23e935f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:17.650910 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fe7dccae-91ac-4893-9ff4-f6a1d23e935f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:17.651642 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fe7dccae-91ac-4893-9ff4-f6a1d23e935f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:17.745040 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-fe7dccae-91ac-4893-9ff4-f6a1d23e935f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:17.754187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-fe7dccae-91ac-4893-9ff4-f6a1d23e935f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1304 microversion: 2.1 time: 0.117988 Jun 30 17:56:17.754719 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 170/356] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:17 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:18.771440 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6a24206a-e318-449b-b77f-b9331ba88327 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:18.772040 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6a24206a-e318-449b-b77f-b9331ba88327 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:18.778409 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a24206a-e318-449b-b77f-b9331ba88327 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:18.778852 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a24206a-e318-449b-b77f-b9331ba88327 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:18.779777 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a24206a-e318-449b-b77f-b9331ba88327 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:18.780174 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a24206a-e318-449b-b77f-b9331ba88327 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:18.908607 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6a24206a-e318-449b-b77f-b9331ba88327 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:18.917216 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6a24206a-e318-449b-b77f-b9331ba88327 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1360 microversion: 2.1 time: 0.149540 Jun 30 17:56:18.927389 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 187/357] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:18 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:19.198262 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-ad7d70a6-7123-42f9-8f54-6c210124cc9d req-d5698385-148e-4e4b-a0e3-6910c79ca5de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14cea2ce-a906-4967-8453-71e73efd83b3", "tag": "f672e4c0-13f1-43b7-b96f-a75cb954be50"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:56:19.211811 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-ad7d70a6-7123-42f9-8f54-6c210124cc9d req-d5698385-148e-4e4b-a0e3-6910c79ca5de service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:19.212476 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-ad7d70a6-7123-42f9-8f54-6c210124cc9d req-d5698385-148e-4e4b-a0e3-6910c79ca5de service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:19.232057 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-ad7d70a6-7123-42f9-8f54-6c210124cc9d req-d5698385-148e-4e4b-a0e3-6910c79ca5de service nova] Creating event network-changed:f672e4c0-13f1-43b7-b96f-a75cb954be50 for instance 14cea2ce-a906-4967-8453-71e73efd83b3 on hv-cinder-81268 Jun 30 17:56:19.237537 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-ad7d70a6-7123-42f9-8f54-6c210124cc9d req-d5698385-148e-4e4b-a0e3-6910c79ca5de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043395 Jun 30 17:56:19.238143 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 171/358] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:56:19.934886 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-12870d0b-9e94-4d39-a9a2-5f308ce9a481 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:19.935416 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-12870d0b-9e94-4d39-a9a2-5f308ce9a481 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:19.937239 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:19.943085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-12870d0b-9e94-4d39-a9a2-5f308ce9a481 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:19.943523 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-12870d0b-9e94-4d39-a9a2-5f308ce9a481 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:19.944266 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-12870d0b-9e94-4d39-a9a2-5f308ce9a481 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:19.944692 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-12870d0b-9e94-4d39-a9a2-5f308ce9a481 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:20.080290 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-12870d0b-9e94-4d39-a9a2-5f308ce9a481 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:20.087672 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-12870d0b-9e94-4d39-a9a2-5f308ce9a481 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1360 microversion: 2.1 time: 0.156687 Jun 30 17:56:20.088263 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 188/359] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:19 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:21.104628 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4b74dc2d-0385-460c-ba30-e16fb4fc8c26 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:21.105307 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4b74dc2d-0385-460c-ba30-e16fb4fc8c26 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:21.111980 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4b74dc2d-0385-460c-ba30-e16fb4fc8c26 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:21.112423 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4b74dc2d-0385-460c-ba30-e16fb4fc8c26 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:21.113165 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4b74dc2d-0385-460c-ba30-e16fb4fc8c26 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:21.113591 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4b74dc2d-0385-460c-ba30-e16fb4fc8c26 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:21.244994 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4b74dc2d-0385-460c-ba30-e16fb4fc8c26 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:21.253106 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4b74dc2d-0385-460c-ba30-e16fb4fc8c26 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1360 microversion: 2.1 time: 0.152987 Jun 30 17:56:21.253689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 172/360] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:21 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:22.269693 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c7a4c410-d9bb-4ff7-bc33-ac20e4edbb62 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:22.270209 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c7a4c410-d9bb-4ff7-bc33-ac20e4edbb62 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:22.276259 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c7a4c410-d9bb-4ff7-bc33-ac20e4edbb62 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:22.276698 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c7a4c410-d9bb-4ff7-bc33-ac20e4edbb62 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:22.277437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c7a4c410-d9bb-4ff7-bc33-ac20e4edbb62 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:22.277858 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c7a4c410-d9bb-4ff7-bc33-ac20e4edbb62 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:22.407793 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c7a4c410-d9bb-4ff7-bc33-ac20e4edbb62 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:22.415129 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c7a4c410-d9bb-4ff7-bc33-ac20e4edbb62 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1360 microversion: 2.1 time: 0.149376 Jun 30 17:56:22.415681 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 189/361] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:22 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:23.431043 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-abf7461e-f6e1-4aab-9aa6-edb51a15410e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:23.431646 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-abf7461e-f6e1-4aab-9aa6-edb51a15410e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:23.437937 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-abf7461e-f6e1-4aab-9aa6-edb51a15410e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:23.438415 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-abf7461e-f6e1-4aab-9aa6-edb51a15410e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:23.439194 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-abf7461e-f6e1-4aab-9aa6-edb51a15410e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:23.439621 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-abf7461e-f6e1-4aab-9aa6-edb51a15410e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:23.568542 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-abf7461e-f6e1-4aab-9aa6-edb51a15410e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:23.576201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-abf7461e-f6e1-4aab-9aa6-edb51a15410e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1360 microversion: 2.1 time: 0.148961 Jun 30 17:56:23.576746 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 173/362] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:23 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:24.592804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5e0940a6-c033-47a1-8962-a70b2a5e6248 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:24.593416 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5e0940a6-c033-47a1-8962-a70b2a5e6248 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:24.600236 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5e0940a6-c033-47a1-8962-a70b2a5e6248 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:24.600676 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5e0940a6-c033-47a1-8962-a70b2a5e6248 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:24.601451 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5e0940a6-c033-47a1-8962-a70b2a5e6248 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:24.601874 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5e0940a6-c033-47a1-8962-a70b2a5e6248 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:24.733001 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-5e0940a6-c033-47a1-8962-a70b2a5e6248 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:24.741050 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5e0940a6-c033-47a1-8962-a70b2a5e6248 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1360 microversion: 2.1 time: 0.152049 Jun 30 17:56:24.741608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 190/363] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:24 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 17:56:25.757621 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-dd55d4d7-1bfb-4155-844b-65903b9f5043 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:25.758231 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-dd55d4d7-1bfb-4155-844b-65903b9f5043 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:25.760684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:25.765972 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dd55d4d7-1bfb-4155-844b-65903b9f5043 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:25.766448 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dd55d4d7-1bfb-4155-844b-65903b9f5043 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:25.767208 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dd55d4d7-1bfb-4155-844b-65903b9f5043 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:25.767862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dd55d4d7-1bfb-4155-844b-65903b9f5043 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:25.850387 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-f3f4cf62-bf0f-46f9-918b-1bdccb42222d req-9e45ce43-1b8d-4639-84aa-14d7a42a3a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14cea2ce-a906-4967-8453-71e73efd83b3", "name": "network-vif-plugged", "status": "completed", "tag": "f672e4c0-13f1-43b7-b96f-a75cb954be50"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:56:25.858734 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f3f4cf62-bf0f-46f9-918b-1bdccb42222d req-9e45ce43-1b8d-4639-84aa-14d7a42a3a0d service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:25.859171 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f3f4cf62-bf0f-46f9-918b-1bdccb42222d req-9e45ce43-1b8d-4639-84aa-14d7a42a3a0d service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:25.873809 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-f3f4cf62-bf0f-46f9-918b-1bdccb42222d req-9e45ce43-1b8d-4639-84aa-14d7a42a3a0d service nova] Creating event network-vif-plugged:f672e4c0-13f1-43b7-b96f-a75cb954be50 for instance 14cea2ce-a906-4967-8453-71e73efd83b3 on hv-cinder-81268 Jun 30 17:56:25.879447 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-f3f4cf62-bf0f-46f9-918b-1bdccb42222d req-9e45ce43-1b8d-4639-84aa-14d7a42a3a0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032401 Jun 30 17:56:25.880042 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 191/364] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 17:56:25.915975 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-dd55d4d7-1bfb-4155-844b-65903b9f5043 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:25.933902 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-dd55d4d7-1bfb-4155-844b-65903b9f5043 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1360 microversion: 2.1 time: 0.179732 Jun 30 17:56:25.944294 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 174/365] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:25 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1360 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:26.961205 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6a8650af-eaed-409e-a0da-3fc0cc3bda59 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:26.962418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6a8650af-eaed-409e-a0da-3fc0cc3bda59 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:26.964089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=6 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:26.964734 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:26.970576 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a8650af-eaed-409e-a0da-3fc0cc3bda59 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:26.971023 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a8650af-eaed-409e-a0da-3fc0cc3bda59 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:26.971783 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a8650af-eaed-409e-a0da-3fc0cc3bda59 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:26.972337 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a8650af-eaed-409e-a0da-3fc0cc3bda59 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:27.104236 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6a8650af-eaed-409e-a0da-3fc0cc3bda59 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:27.112181 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6a8650af-eaed-409e-a0da-3fc0cc3bda59 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1360 microversion: 2.1 time: 0.155160 Jun 30 17:56:27.112755 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 192/366] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:26 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:28.129362 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6f0722b8-c451-4a59-8b11-dfb0368252d4 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:28.129970 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6f0722b8-c451-4a59-8b11-dfb0368252d4 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:28.131868 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:28.132725 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=6 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:28.139141 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f0722b8-c451-4a59-8b11-dfb0368252d4 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:28.139613 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f0722b8-c451-4a59-8b11-dfb0368252d4 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:28.140366 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f0722b8-c451-4a59-8b11-dfb0368252d4 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:28.140801 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f0722b8-c451-4a59-8b11-dfb0368252d4 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:28.265841 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6f0722b8-c451-4a59-8b11-dfb0368252d4 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:28.273779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6f0722b8-c451-4a59-8b11-dfb0368252d4 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1360 microversion: 2.1 time: 0.148805 Jun 30 17:56:28.274355 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 175/367] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:28 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:29.289930 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-90e220b1-07e4-4815-aaf1-515fb5e8a794 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:29.290513 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-90e220b1-07e4-4815-aaf1-515fb5e8a794 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:29.296497 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90e220b1-07e4-4815-aaf1-515fb5e8a794 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:29.296943 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90e220b1-07e4-4815-aaf1-515fb5e8a794 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:29.297691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90e220b1-07e4-4815-aaf1-515fb5e8a794 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:29.298118 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-90e220b1-07e4-4815-aaf1-515fb5e8a794 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:29.423912 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-90e220b1-07e4-4815-aaf1-515fb5e8a794 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 17:56:29.431714 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-90e220b1-07e4-4815-aaf1-515fb5e8a794 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1547 microversion: 2.1 time: 0.145675 Jun 30 17:56:29.432269 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 193/368] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 17:56:29 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 17:56:29.448884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-9f80a9d7-48ca-4aa8-981c-7bb411ce00bf tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:29.449383 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-9f80a9d7-48ca-4aa8-981c-7bb411ce00bf tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:29.455759 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9f80a9d7-48ca-4aa8-981c-7bb411ce00bf tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:29.456197 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9f80a9d7-48ca-4aa8-981c-7bb411ce00bf tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:29.456947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9f80a9d7-48ca-4aa8-981c-7bb411ce00bf tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:29.457375 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-9f80a9d7-48ca-4aa8-981c-7bb411ce00bf tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:29.535148 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-9f80a9d7-48ca-4aa8-981c-7bb411ce00bf tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090235 Jun 30 17:56:29.535741 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 176/369] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 17:56:29 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:56:30.658650 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-a182ab1d-d07f-4b4c-970c-f08c40dad5a6 req-710bce06-2f8c-4881-b0fa-8b321723dfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14cea2ce-a906-4967-8453-71e73efd83b3", "tag": "f672e4c0-13f1-43b7-b96f-a75cb954be50"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 17:56:30.666659 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-a182ab1d-d07f-4b4c-970c-f08c40dad5a6 req-710bce06-2f8c-4881-b0fa-8b321723dfe8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:30.667091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-a182ab1d-d07f-4b4c-970c-f08c40dad5a6 req-710bce06-2f8c-4881-b0fa-8b321723dfe8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:30.678073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-a182ab1d-d07f-4b4c-970c-f08c40dad5a6 req-710bce06-2f8c-4881-b0fa-8b321723dfe8 service nova] Creating event network-changed:f672e4c0-13f1-43b7-b96f-a75cb954be50 for instance 14cea2ce-a906-4967-8453-71e73efd83b3 on hv-cinder-81268 Jun 30 17:56:30.682926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-a182ab1d-d07f-4b4c-970c-f08c40dad5a6 req-710bce06-2f8c-4881-b0fa-8b321723dfe8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028030 Jun 30 17:56:30.683816 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 194/370] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 17:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:56:55.397361 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=5 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:55.398041 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:55.402562 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-85d27283-9380-42d7-b973-6aba92e69e99 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:55.403226 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-85d27283-9380-42d7-b973-6aba92e69e99 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:55.410706 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-85d27283-9380-42d7-b973-6aba92e69e99 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:55.411171 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-85d27283-9380-42d7-b973-6aba92e69e99 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:55.411931 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-85d27283-9380-42d7-b973-6aba92e69e99 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:55.412368 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-85d27283-9380-42d7-b973-6aba92e69e99 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:55.436797 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-85d27283-9380-42d7-b973-6aba92e69e99 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf/ips" status: 200 len: 151 microversion: 2.20 time: 0.041142 Jun 30 17:56:55.437364 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 177/371] 10.222.0.16 () {60 vars in 1288 bytes} [Thu Jun 30 17:56:55 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 17:56:57.258808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=5 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:57.259551 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=60 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:56:57.264151 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-32211823-3c7c-4e52-9b2a-4fce54dea050 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:56:57.264730 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-32211823-3c7c-4e52-9b2a-4fce54dea050 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:56:57.272308 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-32211823-3c7c-4e52-9b2a-4fce54dea050 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:57.272756 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-32211823-3c7c-4e52-9b2a-4fce54dea050 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:57.273516 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-32211823-3c7c-4e52-9b2a-4fce54dea050 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:56:57.274126 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-32211823-3c7c-4e52-9b2a-4fce54dea050 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:56:57.297183 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-32211823-3c7c-4e52-9b2a-4fce54dea050 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225/ips" status: 200 len: 146 microversion: 2.1 time: 0.039485 Jun 30 17:56:57.297734 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 195/372] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 17:56:57 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:57:45.622814 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a2a2ff28-8df2-4b0f-a600-6a611a120a4c tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 17:57:45.623376 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a2a2ff28-8df2-4b0f-a600-6a611a120a4c tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 17:57:45.625228 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:57:45.626066 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=4 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 17:57:45.631482 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a2a2ff28-8df2-4b0f-a600-6a611a120a4c tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:57:45.631946 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a2a2ff28-8df2-4b0f-a600-6a611a120a4c tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:57:45.632709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a2a2ff28-8df2-4b0f-a600-6a611a120a4c tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 17:57:45.633140 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a2a2ff28-8df2-4b0f-a600-6a611a120a4c tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 17:57:45.656564 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a2a2ff28-8df2-4b0f-a600-6a611a120a4c tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3/ips" status: 200 len: 146 microversion: 2.1 time: 0.037748 Jun 30 17:57:45.657131 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 178/373] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 17:57:45 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 17:58:45.717517 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 17:58:45.719063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 17:58:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 17:59:46.215947 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 17:59:46.216467 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 17:59:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:01:17.002811 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:01:17.003638 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:01:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:01:19.156211 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:01:19.156872 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:01:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:01:22.522741 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:01:22.523801 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:01:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:01:38.418263 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:01:38.418761 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:02:05.727255 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:02:05.727792 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:02:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:02:55.226577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:02:55.227325 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=4 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:02:55.232444 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-843f0912-1916-4a9d-b973-c5bc0edc816d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:55.232932 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-843f0912-1916-4a9d-b973-c5bc0edc816d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:02:55.239616 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-843f0912-1916-4a9d-b973-c5bc0edc816d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:55.240059 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-843f0912-1916-4a9d-b973-c5bc0edc816d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:55.240811 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-843f0912-1916-4a9d-b973-c5bc0edc816d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:55.241242 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-843f0912-1916-4a9d-b973-c5bc0edc816d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:55.265727 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-843f0912-1916-4a9d-b973-c5bc0edc816d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Going to try to terminate instance {{(pid=129370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:02:55.339431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-843f0912-1916-4a9d-b973-c5bc0edc816d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 204 len: 0 microversion: 2.20 time: 0.114013 Jun 30 18:02:55.340037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 196/374] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jun 30 18:02:55 2022] DELETE /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 18:02:55.347763 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 30 18:02:55.348289 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:02:55.348997 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=4 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:02:55.353677 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:55.354830 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:02:55.361470 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:55.362286 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:55.363071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:55.363502 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:55.547649 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:55.555797 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:55.557302 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:55.558494 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d67caacc-b09e-4b6f-92e0-d2910080eace tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1723 microversion: 2.20 time: 0.213836 Jun 30 18:02:55.559041 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 179/375] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:02:55 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:02:56.653777 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:56.654659 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:02:56.661186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:56.661636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:56.662438 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:56.662874 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:56.855948 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:56.863981 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:56.865488 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:56.866673 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6107b6b2-73bd-4fe7-894e-be6086b2721f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1723 microversion: 2.20 time: 0.293428 Jun 30 18:02:56.867225 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 197/376] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:02:56 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:02:57.208840 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3ec219ed-8a38-4936-8bf5-5d6149af15c0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:57.209372 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3ec219ed-8a38-4936-8bf5-5d6149af15c0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:02:57.219495 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3ec219ed-8a38-4936-8bf5-5d6149af15c0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:57.219935 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3ec219ed-8a38-4936-8bf5-5d6149af15c0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:57.220704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3ec219ed-8a38-4936-8bf5-5d6149af15c0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:57.221139 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3ec219ed-8a38-4936-8bf5-5d6149af15c0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:57.229520 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48710. Jun 30 18:02:57.252614 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3ec219ed-8a38-4936-8bf5-5d6149af15c0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:02:57.340197 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3ec219ed-8a38-4936-8bf5-5d6149af15c0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 204 len: 0 microversion: 2.1 time: 0.134580 Jun 30 18:02:57.342410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 180/377] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:02:57 2022] DELETE /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:02:57.352810 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-42a76666-ffde-4c76-a0e1-70ff9e9a5747 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:57.353309 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-42a76666-ffde-4c76-a0e1-70ff9e9a5747 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:02:57.360764 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42a76666-ffde-4c76-a0e1-70ff9e9a5747 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:57.361253 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42a76666-ffde-4c76-a0e1-70ff9e9a5747 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:57.362020 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42a76666-ffde-4c76-a0e1-70ff9e9a5747 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:57.362482 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42a76666-ffde-4c76-a0e1-70ff9e9a5747 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:57.522351 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-42a76666-ffde-4c76-a0e1-70ff9e9a5747 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:57.533418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-42a76666-ffde-4c76-a0e1-70ff9e9a5747 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1677 microversion: 2.1 time: 0.186678 Jun 30 18:02:57.534002 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-f0da8dd8-a2ef-455b-8b03-e052a8865219 req-fa11394c-bcac-4bf0-821c-f1ca8f578257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced4f642-e357-49ac-abac-c606c2e747bf", "name": "network-vif-deleted", "tag": "08fa2453-7635-41ad-bc50-b2aec4e2fd7f"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:02:57.534294 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 198/378] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:02:57 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:02:57.544968 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-f0da8dd8-a2ef-455b-8b03-e052a8865219 req-fa11394c-bcac-4bf0-821c-f1ca8f578257 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:57.545578 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-f0da8dd8-a2ef-455b-8b03-e052a8865219 req-fa11394c-bcac-4bf0-821c-f1ca8f578257 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:57.561862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-f0da8dd8-a2ef-455b-8b03-e052a8865219 req-fa11394c-bcac-4bf0-821c-f1ca8f578257 service nova] Creating event network-vif-deleted:08fa2453-7635-41ad-bc50-b2aec4e2fd7f for instance ced4f642-e357-49ac-abac-c606c2e747bf on hv-cinder-81268 Jun 30 18:02:57.572532 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-f0da8dd8-a2ef-455b-8b03-e052a8865219 req-fa11394c-bcac-4bf0-821c-f1ca8f578257 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126538 Jun 30 18:02:57.573324 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 181/379] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:02:57.884732 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:57.885410 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:02:57.892576 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:57.893130 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:57.894471 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:57.895126 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:57.928440 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:57.928885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:57.929334 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.objects.instance [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lazy-loading 'fault' on Instance uuid ced4f642-e357-49ac-abac-c606c2e747bf {{(pid=129370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:02:57.976745 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:57.987392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:57.989202 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:57.990597 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1c4438ad-f5bd-436b-b633-0a4f4c348414 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 200 len: 1371 microversion: 2.20 time: 0.109717 Jun 30 18:02:57.991981 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 199/380] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:02:57 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:02:58.553344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-12414449-d8d5-4018-b9b5-6aeec8cee8cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:58.554045 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-12414449-d8d5-4018-b9b5-6aeec8cee8cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:02:58.560982 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-12414449-d8d5-4018-b9b5-6aeec8cee8cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:58.561653 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-12414449-d8d5-4018-b9b5-6aeec8cee8cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:58.563134 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-12414449-d8d5-4018-b9b5-6aeec8cee8cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:58.563907 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-12414449-d8d5-4018-b9b5-6aeec8cee8cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:58.904231 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-12414449-d8d5-4018-b9b5-6aeec8cee8cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:02:58.913195 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-12414449-d8d5-4018-b9b5-6aeec8cee8cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1677 microversion: 2.1 time: 0.365763 Jun 30 18:02:58.913778 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 182/381] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:02:58 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1677 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:02:59.010137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:59.011636 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:02:59.018054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:59.018663 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:59.019499 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:59.020065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:59.035787 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] HTTP exception thrown: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Request method failure captured: Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf HTTP/1.1 Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveL4rSlN6MGR1fDo5cBblF8rHaqntDflnX06he7Hy25rkmaA-RDOgLVIBFbMg9W7eb3lK7cD2k2DPib8F-uXIhHvGL7xcLbenCdnPyoxspG4_ktaDQnBtJeXLRFfsxtRTasEfPe6tIQjaiYE-rUktIi9-mpb_PVJCqVNqJrHh8tnaK8 Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:02:59.037600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}] Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 63422b2e34eb479f972a181fb37f3608 Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:02:59.039144 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': 'ced4f642-e357-49ac-abac-c606c2e747bf'} Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:02:59.043759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:02:59.045024 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:02:59.046119 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Returning 404 to user: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:02:59.046119 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-845098a5-da2d-40e8-bf09-ae8221873a6d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 404 len: 111 microversion: 2.20 time: 0.032987 Jun 30 18:02:59.046119 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 200/382] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:02:59 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:02:59.051912 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-64a26853-1c7b-4386-9ad8-73316f163418 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '.version_select at 0x7f8f3c342160>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:59.075778 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-64a26853-1c7b-4386-9ad8-73316f163418 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183579316" status: 204 len: 0 microversion: 2.20 time: 0.027541 Jun 30 18:02:59.076356 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 183/383] 10.222.0.16 () {60 vars in 1261 bytes} [Thu Jun 30 18:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183579316 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 18:02:59.589802 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-ba50783f-af2f-48f7-b3d3-4743c01d4ff7 req-ee5b6e54-77b3-4899-a139-d7e2b6793a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed940450-c1a0-4aea-9b4b-65d90d495225", "name": "network-vif-deleted", "tag": "321ba8b4-47c5-40f5-88f0-2fd84bc02ee5"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:02:59.615357 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-ba50783f-af2f-48f7-b3d3-4743c01d4ff7 req-ee5b6e54-77b3-4899-a139-d7e2b6793a2b service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:59.616076 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-ba50783f-af2f-48f7-b3d3-4743c01d4ff7 req-ee5b6e54-77b3-4899-a139-d7e2b6793a2b service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:59.638160 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-ba50783f-af2f-48f7-b3d3-4743c01d4ff7 req-ee5b6e54-77b3-4899-a139-d7e2b6793a2b service nova] Creating event network-vif-deleted:321ba8b4-47c5-40f5-88f0-2fd84bc02ee5 for instance ed940450-c1a0-4aea-9b4b-65d90d495225 on hv-cinder-81268 Jun 30 18:02:59.660613 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-ba50783f-af2f-48f7-b3d3-4743c01d4ff7 req-ee5b6e54-77b3-4899-a139-d7e2b6793a2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074955 Jun 30 18:02:59.661905 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 201/384] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:02:59.932468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:02:59.935206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:02:59.948490 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:59.949569 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:59.950495 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:59.950995 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:59.987075 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:02:59.987539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:02:59.988016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.objects.instance [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lazy-loading 'fault' on Instance uuid ed940450-c1a0-4aea-9b4b-65d90d495225 {{(pid=129371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:03:00.036484 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:00.047194 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6a3c0bab-2fbc-42c1-8479-b5ac5200a127 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 200 len: 1331 microversion: 2.1 time: 0.118866 Jun 30 18:03:00.048321 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 184/385] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:02:59 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:00.101080 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d3d4e5ef-3528-4740-ad1d-4754b956e8e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Action: 'create', calling method: .version_select at 0x7f8f3c5bb160>, body: {"keypair": {"name": "tempest-keypair-1104495435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4haUoOTyoGcjlWilt9M0ywdWoLne38VAHAQQWimeq8fxnkZGESXmPh/iGHjYe8Gq9uek5b3s+sV5lsem6VE4Ucmv4t6Ezsuwa5rcgGDk/B9QrSXeFqh7oWdhr9RNJPjg=="}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:00.117417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-d3d4e5ef-3528-4740-ad1d-4754b956e8e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Getting quotas for project 2ed15171dff7466fab5d482c7fbb7b10. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:03:00.122297 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-d3d4e5ef-3528-4740-ad1d-4754b956e8e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Getting quotas for user 63422b2e34eb479f972a181fb37f3608 and project 2ed15171dff7466fab5d482c7fbb7b10. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:03:00.160412 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d3d4e5ef-3528-4740-ad1d-4754b956e8e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.069585 Jun 30 18:03:00.161078 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 202/386] 10.222.0.16 () {62 vars in 1199 bytes} [Thu Jun 30 18:03:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 18:03:01.065317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:01.065925 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:01.072597 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:01.073048 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:01.073818 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:01.074253 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:01.088369 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] HTTP exception thrown: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Request method failure captured: Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 HTTP/1.1 Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL6FYylAQA5QUtIGY6-WeYVAJCtRDdyGdWxs5CjnPdannJc0DrRTjLsRDIxYwvU8oBpQLLugl0267HszgIUAgQ1uLB0677WnvU0KU4zCLRTz8p_PpddBX44P7RNaVsmiUu0Ehcgtd57WqIqL4h7WWj2Dm5HEkrtfidLTcAbgNyCWJY Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:03:01.090697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}] Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 2ed5e98a29c44296aeb921af4f521042 Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:03:01.092159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': 'ed940450-c1a0-4aea-9b4b-65d90d495225'} Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:03:01.092929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:03:01.094487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:01.095763 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Returning 404 to user: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:03:01.095763 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6f5fd195-1b5f-4f0f-9786-f0f864e53353 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 404 len: 111 microversion: 2.1 time: 0.030977 Jun 30 18:03:01.095763 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 185/387] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:01 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:03:01.101029 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c2080139-ea1a-40b7-af39-b91f0620e0de tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '.version_select at 0x7f8f3c2fdee0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:01.120234 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c2080139-ea1a-40b7-af39-b91f0620e0de tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029274118" status: 202 len: 0 microversion: 2.1 time: 0.022920 Jun 30 18:03:01.121087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 203/388] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jun 30 18:03:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029274118 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:03:01.456001 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1226737705", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9615341-92d6-4123-83a6-4a508b4a2c42"}], "security_groups": [{"name": "tempest-securitygroup--1600705444"}], "key_name": "tempest-keypair-1104495435", "user_data": "}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:01.626835 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] validate_networks() for [('b9615341-92d6-4123-83a6-4a508b4a2c42', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:03:02.001336 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b19ceb72-f8e6-4825-9146-adfe8d42b7df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Action: 'create', calling method: .version_select at 0x7f8f3c41cb80>, body: {"keypair": {"name": "tempest-keypair-6486464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoUjrq8CYzyE7imhh8oYpaI6YShPkNYA3MA/oBG+otvgxlPVK4aO8lyemFtbK9DtoDM0tcnANz+WyFu8PUzDFgY3hDgh29wxksPbFNh1D4z+jvbaeUVaLpJcYke5pDSmg=="}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:02.018110 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-b19ceb72-f8e6-4825-9146-adfe8d42b7df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:03:02.021951 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-b19ceb72-f8e6-4825-9146-adfe8d42b7df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for user 2ed5e98a29c44296aeb921af4f521042 and project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:03:02.044941 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b19ceb72-f8e6-4825-9146-adfe8d42b7df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 383 microversion: 2.1 time: 0.048213 Jun 30 18:03:02.045591 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 204/389] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 18:03:01 2022] POST /compute/v2.1/os-keypairs => generated 383 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:03:02.171876 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:03:02.172328 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:03:02.172816 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:03:02.173284 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:03:02.173764 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:03:02.183650 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:02.184175 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:02.185034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:02.185545 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:02.208365 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Getting quotas for project 2ed15171dff7466fab5d482c7fbb7b10. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:03:02.212675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Getting quotas for user 63422b2e34eb479f972a181fb37f3608 and project 2ed15171dff7466fab5d482c7fbb7b10. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:03:02.225316 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:03:02.227641 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:03:02.276570 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-8476feab-90b4-4c0f-8182-86e167f9f8d3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.824811 Jun 30 18:03:02.277294 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 186/390] 10.222.0.16 () {62 vars in 1187 bytes} [Thu Jun 30 18:03:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 18:03:02.288549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-54389c43-4fac-4b65-8a6f-a3a0f553ba07 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:02.289619 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-54389c43-4fac-4b65-8a6f-a3a0f553ba07 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:02.367964 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-54389c43-4fac-4b65-8a6f-a3a0f553ba07 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:02.375723 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-54389c43-4fac-4b65-8a6f-a3a0f553ba07 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:02.377333 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-54389c43-4fac-4b65-8a6f-a3a0f553ba07 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:02.378497 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-54389c43-4fac-4b65-8a6f-a3a0f553ba07 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1282 microversion: 2.20 time: 0.094427 Jun 30 18:03:02.379368 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 205/391] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:02 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:03:03.271608 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1562989154", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "deee4646-f06a-4861-a34a-8d7afdbfbf09"}], "security_groups": [{"name": "tempest-securitygroup--581347563"}], "key_name": "tempest-keypair-6486464", "user_data": "}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:03.378791 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] validate_networks() for [('deee4646-f06a-4861-a34a-8d7afdbfbf09', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:03:03.400370 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-067f02d2-dd6f-4dc1-8243-041e0177e05c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:03.402384 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-067f02d2-dd6f-4dc1-8243-041e0177e05c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:03.467645 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-067f02d2-dd6f-4dc1-8243-041e0177e05c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:03.475187 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-067f02d2-dd6f-4dc1-8243-041e0177e05c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:03.485711 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-067f02d2-dd6f-4dc1-8243-041e0177e05c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:03.486885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-067f02d2-dd6f-4dc1-8243-041e0177e05c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1282 microversion: 2.20 time: 0.094155 Jun 30 18:03:03.487431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 206/392] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:03 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:03:03.764494 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:03:03.764919 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:03:03.765390 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:03:03.765798 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:03:03.766234 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:03:03.774965 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:03.775412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:03.776208 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:03.776705 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:03.792901 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:03:03.796653 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for user 2ed5e98a29c44296aeb921af4f521042 and project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:03:03.807383 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:03:03.810017 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:03:03.863319 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2ab7f948-e353-455b-ba1b-83fcfb7aac3b tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.596348 Jun 30 18:03:03.864208 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 187/393] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:03:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:03:03.874649 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6c61b7fb-9263-4a12-a2e9-9cf021a7ef22 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:03.875250 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6c61b7fb-9263-4a12-a2e9-9cf021a7ef22 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:03.929314 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6c61b7fb-9263-4a12-a2e9-9cf021a7ef22 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:03.936890 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6c61b7fb-9263-4a12-a2e9-9cf021a7ef22 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1239 microversion: 2.1 time: 0.066512 Jun 30 18:03:03.937692 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 207/394] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:03 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:04.504590 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6511b7fe-ab0e-4491-bf01-3b25f1d489ce tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:04.505191 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6511b7fe-ab0e-4491-bf01-3b25f1d489ce tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:04.560428 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6511b7fe-ab0e-4491-bf01-3b25f1d489ce tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:04.568796 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6511b7fe-ab0e-4491-bf01-3b25f1d489ce tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:04.570121 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6511b7fe-ab0e-4491-bf01-3b25f1d489ce tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:04.571279 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6511b7fe-ab0e-4491-bf01-3b25f1d489ce tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1282 microversion: 2.20 time: 0.070677 Jun 30 18:03:04.580878 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 188/395] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:04 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:03:04.953056 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-852e88d6-b73a-4d1f-b516-1735b0851098 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:04.953710 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-852e88d6-b73a-4d1f-b516-1735b0851098 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:04.960117 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-852e88d6-b73a-4d1f-b516-1735b0851098 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:04.960557 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-852e88d6-b73a-4d1f-b516-1735b0851098 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:04.961318 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-852e88d6-b73a-4d1f-b516-1735b0851098 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:04.961739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-852e88d6-b73a-4d1f-b516-1735b0851098 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:05.026751 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-852e88d6-b73a-4d1f-b516-1735b0851098 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:05.034458 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-852e88d6-b73a-4d1f-b516-1735b0851098 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1297 microversion: 2.1 time: 0.085140 Jun 30 18:03:05.035029 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 208/396] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:04 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:05.590405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b88c94b9-0c91-4485-b36d-4b649116ec06 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:05.591019 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b88c94b9-0c91-4485-b36d-4b649116ec06 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:05.675010 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b88c94b9-0c91-4485-b36d-4b649116ec06 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:05.692003 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b88c94b9-0c91-4485-b36d-4b649116ec06 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:05.693602 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b88c94b9-0c91-4485-b36d-4b649116ec06 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:05.695210 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b88c94b9-0c91-4485-b36d-4b649116ec06 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1282 microversion: 2.20 time: 0.109162 Jun 30 18:03:05.695766 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 189/397] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:05 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:06.051650 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c18a1703-4ac3-4c86-b506-0e6ca84d70e2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:06.052284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c18a1703-4ac3-4c86-b506-0e6ca84d70e2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:06.058726 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c18a1703-4ac3-4c86-b506-0e6ca84d70e2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:06.059165 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c18a1703-4ac3-4c86-b506-0e6ca84d70e2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:06.059970 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c18a1703-4ac3-4c86-b506-0e6ca84d70e2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:06.060401 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c18a1703-4ac3-4c86-b506-0e6ca84d70e2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:06.213279 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c18a1703-4ac3-4c86-b506-0e6ca84d70e2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:06.221323 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c18a1703-4ac3-4c86-b506-0e6ca84d70e2 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1364 microversion: 2.1 time: 0.173476 Jun 30 18:03:06.221924 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 209/398] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:06 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:06.225284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:03:06.225520 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:03:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:03:06.600626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-c1586ee3-ccf3-40b8-9bf2-34ee9e02d028 req-e3b7b7d9-9766-42d5-adeb-2e1f1bd733fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f69cd5f-ec69-4537-8a65-7f5325788f53", "tag": "1dcba5a3-3d42-4153-b6ca-ae31aec9be1d"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:06.622968 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-c1586ee3-ccf3-40b8-9bf2-34ee9e02d028 req-e3b7b7d9-9766-42d5-adeb-2e1f1bd733fb service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:06.623641 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-c1586ee3-ccf3-40b8-9bf2-34ee9e02d028 req-e3b7b7d9-9766-42d5-adeb-2e1f1bd733fb service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:06.639588 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-c1586ee3-ccf3-40b8-9bf2-34ee9e02d028 req-e3b7b7d9-9766-42d5-adeb-2e1f1bd733fb service nova] Creating event network-changed:1dcba5a3-3d42-4153-b6ca-ae31aec9be1d for instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 on hv-cinder-81268 Jun 30 18:03:06.644336 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-c1586ee3-ccf3-40b8-9bf2-34ee9e02d028 req-e3b7b7d9-9766-42d5-adeb-2e1f1bd733fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048149 Jun 30 18:03:06.645086 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 190/399] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:03:06.712386 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:06.713055 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:06.721262 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:06.722372 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:06.723216 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:06.723714 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:06.789309 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:06.798465 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:06.799962 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:06.801077 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-af7c9c51-9247-48f6-9c34-e4cce997e36e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1286 microversion: 2.20 time: 0.092913 Jun 30 18:03:06.801780 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 210/400] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:06 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:07.239398 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6a7b796d-3d67-4c6a-b62c-3280f6e066b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:07.240109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6a7b796d-3d67-4c6a-b62c-3280f6e066b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:07.247121 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a7b796d-3d67-4c6a-b62c-3280f6e066b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:07.248116 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a7b796d-3d67-4c6a-b62c-3280f6e066b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:07.250797 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a7b796d-3d67-4c6a-b62c-3280f6e066b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:07.251243 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6a7b796d-3d67-4c6a-b62c-3280f6e066b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:07.385749 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6a7b796d-3d67-4c6a-b62c-3280f6e066b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:07.393631 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6a7b796d-3d67-4c6a-b62c-3280f6e066b6 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1364 microversion: 2.1 time: 0.158359 Jun 30 18:03:07.394186 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 191/401] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:07 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:07.819267 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:07.819910 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:07.826663 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:07.827106 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:07.827850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:07.828275 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:07.887620 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:07.895289 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:07.896765 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:07.897842 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-626974c6-b894-4090-9221-d9da7726044c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1334 microversion: 2.20 time: 0.082608 Jun 30 18:03:07.898399 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 211/402] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:07 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1334 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:08.410783 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-11cb262a-24e7-48c4-9016-ab6864a69376 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:08.411323 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-11cb262a-24e7-48c4-9016-ab6864a69376 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:08.417758 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-11cb262a-24e7-48c4-9016-ab6864a69376 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:08.418230 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-11cb262a-24e7-48c4-9016-ab6864a69376 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:08.419743 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-11cb262a-24e7-48c4-9016-ab6864a69376 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:08.420173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-11cb262a-24e7-48c4-9016-ab6864a69376 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:08.545591 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-11cb262a-24e7-48c4-9016-ab6864a69376 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:08.552895 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-11cb262a-24e7-48c4-9016-ab6864a69376 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1364 microversion: 2.1 time: 0.146011 Jun 30 18:03:08.553474 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 192/403] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:08 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:08.915547 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:08.916156 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:08.922179 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:08.922661 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:08.923431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:08.923865 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:08.987382 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:08.995787 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:08.997822 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:08.998986 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b82b0811-744d-4ac7-909f-99d935aa18a3 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1334 microversion: 2.20 time: 0.087320 Jun 30 18:03:08.999538 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 212/404] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:08 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:09.569288 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-fdafb9a6-7127-4fe7-9bbf-bce47f5787ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:09.570145 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-fdafb9a6-7127-4fe7-9bbf-bce47f5787ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:09.577251 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fdafb9a6-7127-4fe7-9bbf-bce47f5787ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:09.577700 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fdafb9a6-7127-4fe7-9bbf-bce47f5787ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:09.578521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fdafb9a6-7127-4fe7-9bbf-bce47f5787ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:09.578954 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fdafb9a6-7127-4fe7-9bbf-bce47f5787ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:09.776070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-fdafb9a6-7127-4fe7-9bbf-bce47f5787ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:09.784875 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-fdafb9a6-7127-4fe7-9bbf-bce47f5787ae tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1364 microversion: 2.1 time: 0.219302 Jun 30 18:03:09.786858 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 193/405] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:09 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:10.017072 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:10.017806 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:10.027473 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:10.027967 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:10.029284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:10.029741 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:10.132769 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:10.141628 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:10.143561 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:10.144694 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-04c02ea9-c1f8-4489-afff-f73d787f35e5 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1340 microversion: 2.20 time: 0.131733 Jun 30 18:03:10.145242 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 213/406] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:10 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1340 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:10.803611 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-77cb15c8-4534-4f01-b181-503866e5d25e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:10.804279 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-77cb15c8-4534-4f01-b181-503866e5d25e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:10.811196 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-77cb15c8-4534-4f01-b181-503866e5d25e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:10.811727 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-77cb15c8-4534-4f01-b181-503866e5d25e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:10.812504 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-77cb15c8-4534-4f01-b181-503866e5d25e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:10.813700 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-77cb15c8-4534-4f01-b181-503866e5d25e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:10.977152 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-77cb15c8-4534-4f01-b181-503866e5d25e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:10.986846 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-77cb15c8-4534-4f01-b181-503866e5d25e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1364 microversion: 2.1 time: 0.186241 Jun 30 18:03:10.995647 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 194/407] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:10 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:11.164570 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:11.165397 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:11.172032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:11.172624 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:11.173456 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:11.173963 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:11.383695 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:11.392454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:11.394125 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:11.395455 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2d3e9daa-07ae-4ff1-8d45-cf5b5e278ac4 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1408 microversion: 2.20 time: 0.235337 Jun 30 18:03:11.396083 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 214/408] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:11 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:11.577688 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-71a72fab-729d-406d-a1e1-d22003ca9958 req-59058fcb-5f87-4fc3-9878-ac2f6ab7819b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8cca39-f0ac-4b38-af1c-6d192346d04b", "tag": "5da3fc87-8ff5-4943-9aa7-f605b232bc96"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:11.585780 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-71a72fab-729d-406d-a1e1-d22003ca9958 req-59058fcb-5f87-4fc3-9878-ac2f6ab7819b service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:11.586219 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-71a72fab-729d-406d-a1e1-d22003ca9958 req-59058fcb-5f87-4fc3-9878-ac2f6ab7819b service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:11.597783 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-71a72fab-729d-406d-a1e1-d22003ca9958 req-59058fcb-5f87-4fc3-9878-ac2f6ab7819b service nova] Creating event network-changed:5da3fc87-8ff5-4943-9aa7-f605b232bc96 for instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b on hv-cinder-81268 Jun 30 18:03:11.602965 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-71a72fab-729d-406d-a1e1-d22003ca9958 req-59058fcb-5f87-4fc3-9878-ac2f6ab7819b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115606 Jun 30 18:03:11.603945 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 195/409] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:03:11.900632 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-f21e79ce-eb56-49b0-8a2b-9b935cabd781 req-473bfe90-a1f9-4185-98e3-2177e0ad2376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f69cd5f-ec69-4537-8a65-7f5325788f53", "name": "network-vif-plugged", "status": "completed", "tag": "1dcba5a3-3d42-4153-b6ca-ae31aec9be1d"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:11.909059 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f21e79ce-eb56-49b0-8a2b-9b935cabd781 req-473bfe90-a1f9-4185-98e3-2177e0ad2376 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:11.909479 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f21e79ce-eb56-49b0-8a2b-9b935cabd781 req-473bfe90-a1f9-4185-98e3-2177e0ad2376 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:11.921828 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-f21e79ce-eb56-49b0-8a2b-9b935cabd781 req-473bfe90-a1f9-4185-98e3-2177e0ad2376 service nova] Creating event network-vif-plugged:1dcba5a3-3d42-4153-b6ca-ae31aec9be1d for instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 on hv-cinder-81268 Jun 30 18:03:11.927000 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-f21e79ce-eb56-49b0-8a2b-9b935cabd781 req-473bfe90-a1f9-4185-98e3-2177e0ad2376 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091002 Jun 30 18:03:11.927582 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 215/410] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:03:12.013037 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-e14b7291-8c6a-42f2-a2e0-67f98ae48719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:12.013734 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-e14b7291-8c6a-42f2-a2e0-67f98ae48719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:12.027202 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e14b7291-8c6a-42f2-a2e0-67f98ae48719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:12.027919 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e14b7291-8c6a-42f2-a2e0-67f98ae48719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:12.029686 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e14b7291-8c6a-42f2-a2e0-67f98ae48719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:12.030125 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e14b7291-8c6a-42f2-a2e0-67f98ae48719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:12.159047 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e14b7291-8c6a-42f2-a2e0-67f98ae48719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:12.166470 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-e14b7291-8c6a-42f2-a2e0-67f98ae48719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1364 microversion: 2.1 time: 0.158045 Jun 30 18:03:12.167040 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 196/411] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:12 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:12.413324 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:12.414042 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:12.420215 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:12.420658 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:12.421408 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:12.421838 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:12.549907 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:12.557718 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:12.559216 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:12.560369 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-55498c86-6d09-4abd-9410-d47f55446eeb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1408 microversion: 2.20 time: 0.151269 Jun 30 18:03:12.560916 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 216/412] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:12 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:13.183862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b42ebcc7-7bad-4f1b-9415-d9757b61d1df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:13.185087 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b42ebcc7-7bad-4f1b-9415-d9757b61d1df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:13.191931 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b42ebcc7-7bad-4f1b-9415-d9757b61d1df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:13.192425 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b42ebcc7-7bad-4f1b-9415-d9757b61d1df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:13.193195 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b42ebcc7-7bad-4f1b-9415-d9757b61d1df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:13.193634 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b42ebcc7-7bad-4f1b-9415-d9757b61d1df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:13.330857 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b42ebcc7-7bad-4f1b-9415-d9757b61d1df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:13.338241 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b42ebcc7-7bad-4f1b-9415-d9757b61d1df tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1364 microversion: 2.1 time: 0.158124 Jun 30 18:03:13.338770 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 197/413] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:13 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:13.580971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:13.581561 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:13.587978 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:13.588659 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:13.589364 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:13.589809 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:13.722619 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:13.730393 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:13.732496 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:13.733594 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-cf87cd7e-6728-40cb-90fc-5d10c7dab0df tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1408 microversion: 2.20 time: 0.156506 Jun 30 18:03:13.734123 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 217/414] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:13 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:14.354948 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c499f90a-da24-4089-a1df-1ebcf790c4aa tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:14.355558 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c499f90a-da24-4089-a1df-1ebcf790c4aa tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:14.357656 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=4 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:03:14.363489 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c499f90a-da24-4089-a1df-1ebcf790c4aa tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:14.363939 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c499f90a-da24-4089-a1df-1ebcf790c4aa tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:14.364702 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c499f90a-da24-4089-a1df-1ebcf790c4aa tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:14.365137 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c499f90a-da24-4089-a1df-1ebcf790c4aa tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:14.493160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-c499f90a-da24-4089-a1df-1ebcf790c4aa tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:14.500866 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-c499f90a-da24-4089-a1df-1ebcf790c4aa tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1364 microversion: 2.1 time: 0.149719 Jun 30 18:03:14.501414 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 198/415] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:14 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:14.750719 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:14.751353 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:14.753305 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=14 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:03:14.758748 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:14.759191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:14.759991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:14.760421 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:14.780096 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:03:14.935961 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:14.945254 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:14.946772 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:14.947875 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-09bc3cfb-d6fe-4f2e-a21a-f9adbccdab3d tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1408 microversion: 2.20 time: 0.201078 Jun 30 18:03:14.948423 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 218/416] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:14 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:15.517573 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-397a230e-66be-48ff-bfd8-5f9ac3fc034a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:15.518285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-397a230e-66be-48ff-bfd8-5f9ac3fc034a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:15.524632 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-397a230e-66be-48ff-bfd8-5f9ac3fc034a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:15.525075 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-397a230e-66be-48ff-bfd8-5f9ac3fc034a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:15.525828 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-397a230e-66be-48ff-bfd8-5f9ac3fc034a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:15.526254 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-397a230e-66be-48ff-bfd8-5f9ac3fc034a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:15.662064 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-397a230e-66be-48ff-bfd8-5f9ac3fc034a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:15.670582 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-397a230e-66be-48ff-bfd8-5f9ac3fc034a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1364 microversion: 2.1 time: 0.157667 Jun 30 18:03:15.671148 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 199/417] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:15 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:15.966103 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:15.966738 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:15.973535 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:15.973982 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:15.974774 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:15.975369 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:16.108088 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:16.115953 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:16.117441 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:16.118579 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-814ff659-5b52-4118-9399-3aee5d3ae899 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1408 microversion: 2.20 time: 0.156310 Jun 30 18:03:16.119163 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 219/418] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:15 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:03:16.686894 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-484fb8fb-2ab1-4177-be6a-e757079e06e7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:16.687503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-484fb8fb-2ab1-4177-be6a-e757079e06e7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:16.689592 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=16 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:03:16.695371 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-484fb8fb-2ab1-4177-be6a-e757079e06e7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:16.695815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-484fb8fb-2ab1-4177-be6a-e757079e06e7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:16.696574 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-484fb8fb-2ab1-4177-be6a-e757079e06e7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:16.697008 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-484fb8fb-2ab1-4177-be6a-e757079e06e7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:16.716252 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:03:16.828600 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-484fb8fb-2ab1-4177-be6a-e757079e06e7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:16.835928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-484fb8fb-2ab1-4177-be6a-e757079e06e7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1553 microversion: 2.1 time: 0.152826 Jun 30 18:03:16.836487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 200/419] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:16 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:16.852487 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a3c2c23b-ef83-41c9-9eb3-59216a94bb74 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:16.853090 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a3c2c23b-ef83-41c9-9eb3-59216a94bb74 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:16.859123 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a3c2c23b-ef83-41c9-9eb3-59216a94bb74 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:16.859586 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a3c2c23b-ef83-41c9-9eb3-59216a94bb74 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:16.860377 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a3c2c23b-ef83-41c9-9eb3-59216a94bb74 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:16.860810 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a3c2c23b-ef83-41c9-9eb3-59216a94bb74 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:16.953101 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a3c2c23b-ef83-41c9-9eb3-59216a94bb74 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104372 Jun 30 18:03:16.953683 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 220/420] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 18:03:16 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:03:17.136874 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:17.137485 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:17.144014 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:17.144462 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:17.145243 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:17.145677 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:17.281149 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:17.287714 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:17.289290 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:17.290625 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-bcab1fbe-4b89-405b-8cff-8d578bd95494 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1408 microversion: 2.20 time: 0.157527 Jun 30 18:03:17.301406 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 201/421] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:17 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:17.857631 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-5c9ae27d-8fd0-4011-90d2-bc89b7485195 req-975fea4b-a9bc-4a48-821c-fd3e899d4d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f69cd5f-ec69-4537-8a65-7f5325788f53", "tag": "1dcba5a3-3d42-4153-b6ca-ae31aec9be1d"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:17.867575 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-5c9ae27d-8fd0-4011-90d2-bc89b7485195 req-975fea4b-a9bc-4a48-821c-fd3e899d4d2a service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:17.868206 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-5c9ae27d-8fd0-4011-90d2-bc89b7485195 req-975fea4b-a9bc-4a48-821c-fd3e899d4d2a service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:17.881748 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-5c9ae27d-8fd0-4011-90d2-bc89b7485195 req-975fea4b-a9bc-4a48-821c-fd3e899d4d2a service nova] Creating event network-changed:1dcba5a3-3d42-4153-b6ca-ae31aec9be1d for instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 on hv-cinder-81268 Jun 30 18:03:17.889426 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-5c9ae27d-8fd0-4011-90d2-bc89b7485195 req-975fea4b-a9bc-4a48-821c-fd3e899d4d2a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034712 Jun 30 18:03:17.890767 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 221/422] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:03:17.901111 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-0ff7cc60-6306-48b7-8e66-815425fcaa65 req-0e2f8e59-daed-4c88-979d-4210860d6259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8cca39-f0ac-4b38-af1c-6d192346d04b", "name": "network-vif-plugged", "status": "completed", "tag": "5da3fc87-8ff5-4943-9aa7-f605b232bc96"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:17.912501 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-0ff7cc60-6306-48b7-8e66-815425fcaa65 req-0e2f8e59-daed-4c88-979d-4210860d6259 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:17.913010 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-0ff7cc60-6306-48b7-8e66-815425fcaa65 req-0e2f8e59-daed-4c88-979d-4210860d6259 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:17.934312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-0ff7cc60-6306-48b7-8e66-815425fcaa65 req-0e2f8e59-daed-4c88-979d-4210860d6259 service nova] Creating event network-vif-plugged:5da3fc87-8ff5-4943-9aa7-f605b232bc96 for instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b on hv-cinder-81268 Jun 30 18:03:17.947968 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-0ff7cc60-6306-48b7-8e66-815425fcaa65 req-0e2f8e59-daed-4c88-979d-4210860d6259 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049623 Jun 30 18:03:17.948872 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 202/423] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:03:18.309180 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:18.309868 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:18.316915 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:18.317600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:18.318371 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:18.318963 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:18.460507 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:18.468498 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:18.470066 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:18.471290 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c90d0a8d-3117-4b82-8632-376aeab92c89 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1408 microversion: 2.20 time: 0.166404 Jun 30 18:03:18.471850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 222/424] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:18 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:19.490181 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:19.491002 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:19.497137 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:19.497585 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:19.498349 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:19.498792 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:19.625098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:19.633041 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:19.634574 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:19.635676 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-75c99fc9-42e8-4d03-b9b0-054228f49c1e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1408 microversion: 2.20 time: 0.150209 Jun 30 18:03:19.636230 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 203/425] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:19 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:03:20.653175 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:20.654204 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:20.661083 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:20.661520 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:20.662284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:20.662738 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:20.800592 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:20.808484 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:20.810414 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:20.811640 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-7f8abae3-8aae-41c1-99d6-39ccdcbd8eee tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1599 microversion: 2.20 time: 0.162463 Jun 30 18:03:20.812269 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 223/426] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:03:20 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:03:20.831082 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-22eca3f8-aec3-48fd-80db-1e4354ab21d8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:20.831570 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-22eca3f8-aec3-48fd-80db-1e4354ab21d8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:20.838105 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-22eca3f8-aec3-48fd-80db-1e4354ab21d8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:20.838585 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-22eca3f8-aec3-48fd-80db-1e4354ab21d8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:20.839343 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-22eca3f8-aec3-48fd-80db-1e4354ab21d8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:20.839773 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-22eca3f8-aec3-48fd-80db-1e4354ab21d8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:20.923815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-22eca3f8-aec3-48fd-80db-1e4354ab21d8 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097097 Jun 30 18:03:20.924405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 204/427] 10.222.0.16 () {60 vars in 1315 bytes} [Thu Jun 30 18:03:20 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 18:03:21.823640 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-5b83c31a-0a24-418e-890d-831fd0ade805 req-bd73a31e-892c-420a-8579-d65e8b697db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8cca39-f0ac-4b38-af1c-6d192346d04b", "tag": "5da3fc87-8ff5-4943-9aa7-f605b232bc96"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:21.834901 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-5b83c31a-0a24-418e-890d-831fd0ade805 req-bd73a31e-892c-420a-8579-d65e8b697db7 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:21.835370 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-5b83c31a-0a24-418e-890d-831fd0ade805 req-bd73a31e-892c-420a-8579-d65e8b697db7 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:21.847910 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-5b83c31a-0a24-418e-890d-831fd0ade805 req-bd73a31e-892c-420a-8579-d65e8b697db7 service nova] Creating event network-changed:5da3fc87-8ff5-4943-9aa7-f605b232bc96 for instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b on hv-cinder-81268 Jun 30 18:03:21.854514 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-5b83c31a-0a24-418e-890d-831fd0ade805 req-bd73a31e-892c-420a-8579-d65e8b697db7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034388 Jun 30 18:03:21.855237 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 224/428] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:03:47.025978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:03:47.026768 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=20 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:03:47.030867 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d40f3e6c-4d6b-4181-9e98-cca6105bca1d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:47.031513 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d40f3e6c-4d6b-4181-9e98-cca6105bca1d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:47.038615 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d40f3e6c-4d6b-4181-9e98-cca6105bca1d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:47.039064 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d40f3e6c-4d6b-4181-9e98-cca6105bca1d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:47.039818 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d40f3e6c-4d6b-4181-9e98-cca6105bca1d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:47.040249 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d40f3e6c-4d6b-4181-9e98-cca6105bca1d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:47.068281 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d40f3e6c-4d6b-4181-9e98-cca6105bca1d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:03:47.142196 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d40f3e6c-4d6b-4181-9e98-cca6105bca1d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "DELETE /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 204 len: 0 microversion: 2.1 time: 0.117464 Jun 30 18:03:47.142833 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 205/429] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:03:47 2022] DELETE /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:03:47.149352 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:03:47.150232 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=28 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:03:47.155043 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-24724b57-96c6-49a8-9554-b639739980d3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:47.155729 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-24724b57-96c6-49a8-9554-b639739980d3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:47.163616 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-24724b57-96c6-49a8-9554-b639739980d3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:47.164060 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-24724b57-96c6-49a8-9554-b639739980d3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:47.164815 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-24724b57-96c6-49a8-9554-b639739980d3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:47.165243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-24724b57-96c6-49a8-9554-b639739980d3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:47.295457 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-24724b57-96c6-49a8-9554-b639739980d3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:47.303463 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-24724b57-96c6-49a8-9554-b639739980d3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1671 microversion: 2.1 time: 0.155391 Jun 30 18:03:47.304019 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 225/430] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:47 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:03:48.321348 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-056f7771-e6e0-4a6c-a3a9-138814687ca3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:48.322169 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-056f7771-e6e0-4a6c-a3a9-138814687ca3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:48.329452 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-056f7771-e6e0-4a6c-a3a9-138814687ca3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:48.329896 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-056f7771-e6e0-4a6c-a3a9-138814687ca3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:48.330685 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-056f7771-e6e0-4a6c-a3a9-138814687ca3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:48.331115 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-056f7771-e6e0-4a6c-a3a9-138814687ca3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:48.462650 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-056f7771-e6e0-4a6c-a3a9-138814687ca3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:48.470875 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-056f7771-e6e0-4a6c-a3a9-138814687ca3 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 200 len: 1671 microversion: 2.1 time: 0.153801 Jun 30 18:03:48.471441 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 206/431] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:48 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:48.758669 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-11cd8a2f-40cd-472e-aeb3-87e8e9e06b4e req-7cdcbd11-ddbb-4460-ae3a-ddbc3c21c093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14cea2ce-a906-4967-8453-71e73efd83b3", "name": "network-vif-deleted", "tag": "f672e4c0-13f1-43b7-b96f-a75cb954be50"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:48.778585 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-11cd8a2f-40cd-472e-aeb3-87e8e9e06b4e req-7cdcbd11-ddbb-4460-ae3a-ddbc3c21c093 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:48.779027 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-11cd8a2f-40cd-472e-aeb3-87e8e9e06b4e req-7cdcbd11-ddbb-4460-ae3a-ddbc3c21c093 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:48.797829 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-11cd8a2f-40cd-472e-aeb3-87e8e9e06b4e req-7cdcbd11-ddbb-4460-ae3a-ddbc3c21c093 service nova] Creating event network-vif-deleted:f672e4c0-13f1-43b7-b96f-a75cb954be50 for instance 14cea2ce-a906-4967-8453-71e73efd83b3 on hv-cinder-81268 Jun 30 18:03:48.804137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-11cd8a2f-40cd-472e-aeb3-87e8e9e06b4e req-7cdcbd11-ddbb-4460-ae3a-ddbc3c21c093 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051240 Jun 30 18:03:48.805607 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 226/432] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:03:49.487753 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:49.488365 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:49.495064 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:49.495510 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:49.496280 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:49.496712 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:49.510867 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] HTTP exception thrown: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Request method failure captured: Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 HTTP/1.1 Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveO8_DJNnIYx8_lK_AvekTa_Ex0d3B8UPO_hZX1TCze0KzPLX6UQkEZzpZrLXmWYXGRyRKwlh1-SjLvhidEcgaSSXtAFNHY7Ksf05TeDBhBUCEz_-Vm-0q6z0e00YDL891uTA5qwWDA4WNUa4s-uy6AkJ8Duru_qHD0TAr9m5ZYYqwo Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:03:49.512508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/221481e35182443995ea17136383f6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_221481e35182443995ea17136383f6f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}] Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: de0ef30352514ef9bb4559473e096ea6 Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:03:49.513908 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '14cea2ce-a906-4967-8453-71e73efd83b3'} Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:03:49.514790 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:03:49.516682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:03:49.517890 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Returning 404 to user: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:03:49.517890 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-80eac977-56c5-45d2-b443-f86a8789ffad tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 404 len: 111 microversion: 2.1 time: 0.030128 Jun 30 18:03:49.517890 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 207/433] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:49 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:03:49.523925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2a0dc262-7e65-45cb-ad18-7b148dbb143b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '.version_select at 0x7f8f3c2a4700>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:49.540930 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2a0dc262-7e65-45cb-ad18-7b148dbb143b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4136570" status: 202 len: 0 microversion: 2.1 time: 0.021029 Jun 30 18:03:49.541494 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 227/434] 10.222.0.16 () {58 vars in 1211 bytes} [Thu Jun 30 18:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4136570 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:03:50.186963 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1ce18e28-928b-42f8-8770-4fb19eae130a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Action: 'create', calling method: .version_select at 0x7f8f3c29ee50>, body: {"keypair": {"name": "tempest-keypair-1357535986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs8vRJIPSgh6p2xtYs9H8BtMKYz9TfZY3NrhreF3YgGDHKpY7wZ33WSsP5KkO/RPK53u2Xvj2/oNmnKfomqFpkAHw2mjgf3ntNcEzZNGXxnIMUjM7Axz4GG0vmBJkpAXg=="}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:50.201384 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-1ce18e28-928b-42f8-8770-4fb19eae130a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Getting quotas for project 221481e35182443995ea17136383f6f4. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:03:50.205150 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-1ce18e28-928b-42f8-8770-4fb19eae130a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Getting quotas for user de0ef30352514ef9bb4559473e096ea6 and project 221481e35182443995ea17136383f6f4. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:03:50.230071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1ce18e28-928b-42f8-8770-4fb19eae130a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046831 Jun 30 18:03:50.230699 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 208/435] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 18:03:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:03:51.654433 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1491460782", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a4b8b46-fc60-41bc-90ea-26f4138eda22"}], "security_groups": [{"name": "tempest-securitygroup--1957708146"}], "key_name": "tempest-keypair-1357535986", "user_data": "}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:51.756930 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.network.neutron [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] validate_networks() for [('5a4b8b46-fc60-41bc-90ea-26f4138eda22', None, None, None, None, None)] {{(pid=129370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:03:52.181126 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Flavor limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:03:52.181542 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Image limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:03:52.182007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Flavor pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:03:52.182451 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Image pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:03:52.182857 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:03:52.191838 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:52.192279 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:52.193062 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:52.193493 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:52.209571 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Getting quotas for project 221481e35182443995ea17136383f6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:03:52.214205 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Getting quotas for user de0ef30352514ef9bb4559473e096ea6 and project 221481e35182443995ea17136383f6f4. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:03:52.225898 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Going to run 1 instances... {{(pid=129370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:03:52.228280 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:03:52.274806 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-dcda9d07-7c5f-4121-9576-5abed31ddb44 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.624666 Jun 30 18:03:52.275447 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 228/436] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:03:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:03:52.286187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5402cb1e-9b80-4e97-b375-9cd2c4d63e4e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:52.286832 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5402cb1e-9b80-4e97-b375-9cd2c4d63e4e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:52.356589 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-5402cb1e-9b80-4e97-b375-9cd2c4d63e4e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:52.363986 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5402cb1e-9b80-4e97-b375-9cd2c4d63e4e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1238 microversion: 2.1 time: 0.082567 Jun 30 18:03:52.364550 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 209/437] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:52 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:53.381592 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-98146938-828a-40f2-8147-45c38b2dfe2b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:53.382205 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-98146938-828a-40f2-8147-45c38b2dfe2b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:53.388639 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-98146938-828a-40f2-8147-45c38b2dfe2b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:53.389086 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-98146938-828a-40f2-8147-45c38b2dfe2b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:53.389863 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-98146938-828a-40f2-8147-45c38b2dfe2b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:53.390513 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-98146938-828a-40f2-8147-45c38b2dfe2b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:53.462299 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-98146938-828a-40f2-8147-45c38b2dfe2b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:53.470370 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-98146938-828a-40f2-8147-45c38b2dfe2b tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1296 microversion: 2.1 time: 0.092648 Jun 30 18:03:53.470933 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 229/438] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:53 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:54.488277 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6f56b43f-36f5-41c9-bf88-164f7e87fae0 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:54.488894 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6f56b43f-36f5-41c9-bf88-164f7e87fae0 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:54.495652 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f56b43f-36f5-41c9-bf88-164f7e87fae0 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:54.496250 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f56b43f-36f5-41c9-bf88-164f7e87fae0 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:54.497228 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f56b43f-36f5-41c9-bf88-164f7e87fae0 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:54.497920 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6f56b43f-36f5-41c9-bf88-164f7e87fae0 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:54.613181 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-a12d4618-a9ba-44c9-a9d3-6b946891c0e9 req-ac3ef706-5c24-421e-ab54-e9590b6c0e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33741f52-1148-4d99-ae73-49c3af917033", "tag": "bd44f027-e47c-4b7a-9868-8b92b116233a"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:03:54.622985 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-a12d4618-a9ba-44c9-a9d3-6b946891c0e9 req-ac3ef706-5c24-421e-ab54-e9590b6c0e5c service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:54.623691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-a12d4618-a9ba-44c9-a9d3-6b946891c0e9 req-ac3ef706-5c24-421e-ab54-e9590b6c0e5c service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:54.638716 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-a12d4618-a9ba-44c9-a9d3-6b946891c0e9 req-ac3ef706-5c24-421e-ab54-e9590b6c0e5c service nova] Creating event network-changed:bd44f027-e47c-4b7a-9868-8b92b116233a for instance 33741f52-1148-4d99-ae73-49c3af917033 on hv-cinder-81268 Jun 30 18:03:54.644228 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-a12d4618-a9ba-44c9-a9d3-6b946891c0e9 req-ac3ef706-5c24-421e-ab54-e9590b6c0e5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035208 Jun 30 18:03:54.645296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 230/439] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:03:54.659745 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6f56b43f-36f5-41c9-bf88-164f7e87fae0 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:54.667828 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6f56b43f-36f5-41c9-bf88-164f7e87fae0 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1364 microversion: 2.1 time: 0.184246 Jun 30 18:03:54.668767 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 210/440] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:54 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:55.688266 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b2bff2b6-1c13-414e-8878-bed327cea9b1 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:55.689100 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b2bff2b6-1c13-414e-8878-bed327cea9b1 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:55.695517 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b2bff2b6-1c13-414e-8878-bed327cea9b1 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:55.695967 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b2bff2b6-1c13-414e-8878-bed327cea9b1 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:55.696720 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b2bff2b6-1c13-414e-8878-bed327cea9b1 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:55.697151 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b2bff2b6-1c13-414e-8878-bed327cea9b1 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:55.834999 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b2bff2b6-1c13-414e-8878-bed327cea9b1 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:55.842303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b2bff2b6-1c13-414e-8878-bed327cea9b1 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1364 microversion: 2.1 time: 0.158951 Jun 30 18:03:55.842878 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 231/441] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:55 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:56.859336 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5b1a98ab-ef7a-4b43-9f0a-e4637c8bf7c2 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:56.859966 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5b1a98ab-ef7a-4b43-9f0a-e4637c8bf7c2 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:56.866481 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b1a98ab-ef7a-4b43-9f0a-e4637c8bf7c2 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:56.866927 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b1a98ab-ef7a-4b43-9f0a-e4637c8bf7c2 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:56.867675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b1a98ab-ef7a-4b43-9f0a-e4637c8bf7c2 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:56.868099 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b1a98ab-ef7a-4b43-9f0a-e4637c8bf7c2 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:56.995811 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-5b1a98ab-ef7a-4b43-9f0a-e4637c8bf7c2 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:57.003725 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5b1a98ab-ef7a-4b43-9f0a-e4637c8bf7c2 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1364 microversion: 2.1 time: 0.148315 Jun 30 18:03:57.004285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 211/442] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:56 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:03:58.022495 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d91cf04b-5fef-48dd-befb-7cdfb501a567 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:58.030256 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-d91cf04b-5fef-48dd-befb-7cdfb501a567 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:58.042816 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d91cf04b-5fef-48dd-befb-7cdfb501a567 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:58.043263 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d91cf04b-5fef-48dd-befb-7cdfb501a567 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:58.044034 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d91cf04b-5fef-48dd-befb-7cdfb501a567 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:58.044470 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d91cf04b-5fef-48dd-befb-7cdfb501a567 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:58.231919 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-d91cf04b-5fef-48dd-befb-7cdfb501a567 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:58.239908 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d91cf04b-5fef-48dd-befb-7cdfb501a567 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1364 microversion: 2.1 time: 0.222465 Jun 30 18:03:58.240461 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 232/443] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:58 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:03:59.257192 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-db083f9e-7a95-4c87-bc1b-425ab039ab49 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:03:59.257797 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-db083f9e-7a95-4c87-bc1b-425ab039ab49 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:03:59.264073 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-db083f9e-7a95-4c87-bc1b-425ab039ab49 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:59.264518 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-db083f9e-7a95-4c87-bc1b-425ab039ab49 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:59.265266 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-db083f9e-7a95-4c87-bc1b-425ab039ab49 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:03:59.266383 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-db083f9e-7a95-4c87-bc1b-425ab039ab49 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:03:59.399148 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-db083f9e-7a95-4c87-bc1b-425ab039ab49 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:03:59.406409 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-db083f9e-7a95-4c87-bc1b-425ab039ab49 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1364 microversion: 2.1 time: 0.152970 Jun 30 18:03:59.407002 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 212/444] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:03:59 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:04:00.249404 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-60b77932-0a69-4b26-b3f4-1e1c61646dcd req-78778f80-09aa-4dfe-92d5-a1faef6ac203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33741f52-1148-4d99-ae73-49c3af917033", "name": "network-vif-plugged", "status": "completed", "tag": "bd44f027-e47c-4b7a-9868-8b92b116233a"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:04:00.257927 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-60b77932-0a69-4b26-b3f4-1e1c61646dcd req-78778f80-09aa-4dfe-92d5-a1faef6ac203 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:00.258300 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-60b77932-0a69-4b26-b3f4-1e1c61646dcd req-78778f80-09aa-4dfe-92d5-a1faef6ac203 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:00.269687 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-60b77932-0a69-4b26-b3f4-1e1c61646dcd req-78778f80-09aa-4dfe-92d5-a1faef6ac203 service nova] Creating event network-vif-plugged:bd44f027-e47c-4b7a-9868-8b92b116233a for instance 33741f52-1148-4d99-ae73-49c3af917033 on hv-cinder-81268 Jun 30 18:04:00.274577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-60b77932-0a69-4b26-b3f4-1e1c61646dcd req-78778f80-09aa-4dfe-92d5-a1faef6ac203 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028710 Jun 30 18:04:00.275163 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 233/445] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:04:00.423538 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d7e83a52-8b14-4ba7-8489-4a2e91aed4bd tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:04:00.424167 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d7e83a52-8b14-4ba7-8489-4a2e91aed4bd tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:04:00.431067 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d7e83a52-8b14-4ba7-8489-4a2e91aed4bd tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:00.431517 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d7e83a52-8b14-4ba7-8489-4a2e91aed4bd tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:00.432278 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d7e83a52-8b14-4ba7-8489-4a2e91aed4bd tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:00.432709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d7e83a52-8b14-4ba7-8489-4a2e91aed4bd tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:00.565064 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d7e83a52-8b14-4ba7-8489-4a2e91aed4bd tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:04:00.572452 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d7e83a52-8b14-4ba7-8489-4a2e91aed4bd tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1364 microversion: 2.1 time: 0.153294 Jun 30 18:04:00.573019 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 213/446] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:04:00 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:04:01.590441 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b327192d-0467-451f-8be8-7d25982a7583 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:04:01.591085 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b327192d-0467-451f-8be8-7d25982a7583 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:04:01.597893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b327192d-0467-451f-8be8-7d25982a7583 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:01.598360 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b327192d-0467-451f-8be8-7d25982a7583 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:01.599106 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b327192d-0467-451f-8be8-7d25982a7583 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:01.599538 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b327192d-0467-451f-8be8-7d25982a7583 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:01.735167 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b327192d-0467-451f-8be8-7d25982a7583 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:04:01.743744 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b327192d-0467-451f-8be8-7d25982a7583 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1364 microversion: 2.1 time: 0.157564 Jun 30 18:04:01.744313 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 234/447] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:04:01 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:04:02.757939 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=6 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:04:02.762165 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-72086d26-6332-4b15-8ac6-f0a8f0284710 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:04:02.762973 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-72086d26-6332-4b15-8ac6-f0a8f0284710 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:04:02.771992 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-72086d26-6332-4b15-8ac6-f0a8f0284710 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:02.772708 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-72086d26-6332-4b15-8ac6-f0a8f0284710 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:02.773940 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-72086d26-6332-4b15-8ac6-f0a8f0284710 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:02.775032 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-72086d26-6332-4b15-8ac6-f0a8f0284710 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:02.923080 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-72086d26-6332-4b15-8ac6-f0a8f0284710 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:04:02.930617 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-72086d26-6332-4b15-8ac6-f0a8f0284710 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1550 microversion: 2.1 time: 0.173929 Jun 30 18:04:02.931187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 214/448] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:04:02 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:04:02.943945 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:04:02.944685 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=6 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:04:02.949597 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-61082ba4-7001-4568-9617-d7617e6db5fc tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:04:02.950081 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-61082ba4-7001-4568-9617-d7617e6db5fc tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:04:02.957997 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-61082ba4-7001-4568-9617-d7617e6db5fc tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:02.958467 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-61082ba4-7001-4568-9617-d7617e6db5fc tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:02.959418 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-61082ba4-7001-4568-9617-d7617e6db5fc tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:02.959842 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-61082ba4-7001-4568-9617-d7617e6db5fc tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:03.036278 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-61082ba4-7001-4568-9617-d7617e6db5fc tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093023 Jun 30 18:04:03.036866 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 235/449] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 18:04:02 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:04:03.941176 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-3319d41d-d87c-4b7f-a884-0ff029ec47e4 req-f4922cfb-b4e6-4997-b40e-3a9540682ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33741f52-1148-4d99-ae73-49c3af917033", "tag": "bd44f027-e47c-4b7a-9868-8b92b116233a"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:04:03.949535 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-3319d41d-d87c-4b7f-a884-0ff029ec47e4 req-f4922cfb-b4e6-4997-b40e-3a9540682ea1 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:03.949974 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-3319d41d-d87c-4b7f-a884-0ff029ec47e4 req-f4922cfb-b4e6-4997-b40e-3a9540682ea1 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:03.962019 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-3319d41d-d87c-4b7f-a884-0ff029ec47e4 req-f4922cfb-b4e6-4997-b40e-3a9540682ea1 service nova] Creating event network-changed:bd44f027-e47c-4b7a-9868-8b92b116233a for instance 33741f52-1148-4d99-ae73-49c3af917033 on hv-cinder-81268 Jun 30 18:04:03.967132 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-3319d41d-d87c-4b7f-a884-0ff029ec47e4 req-f4922cfb-b4e6-4997-b40e-3a9540682ea1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029844 Jun 30 18:04:03.967723 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 215/450] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:04:32.811377 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:04:32.812170 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=42 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:04:32.817706 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-f488972a-828b-4866-b8f9-4d5e4c673b78 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:04:32.818608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-f488972a-828b-4866-b8f9-4d5e4c673b78 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:04:32.826743 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f488972a-828b-4866-b8f9-4d5e4c673b78 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:32.827271 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f488972a-828b-4866-b8f9-4d5e4c673b78 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:32.828034 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f488972a-828b-4866-b8f9-4d5e4c673b78 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:32.828466 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f488972a-828b-4866-b8f9-4d5e4c673b78 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:32.854010 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-f488972a-828b-4866-b8f9-4d5e4c673b78 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53/ips" status: 200 len: 149 microversion: 2.1 time: 0.043828 Jun 30 18:04:32.854527 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 236/451] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 18:04:32 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:04:34.883173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:04:34.883905 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:04:34.888178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4c6e5bbe-3c14-4293-9313-524646f2424b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:04:34.888752 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4c6e5bbe-3c14-4293-9313-524646f2424b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:04:34.896692 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4c6e5bbe-3c14-4293-9313-524646f2424b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:34.897145 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4c6e5bbe-3c14-4293-9313-524646f2424b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:34.897907 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4c6e5bbe-3c14-4293-9313-524646f2424b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:04:34.898355 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4c6e5bbe-3c14-4293-9313-524646f2424b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:04:34.923389 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4c6e5bbe-3c14-4293-9313-524646f2424b tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b/ips" status: 200 len: 150 microversion: 2.20 time: 0.041767 Jun 30 18:04:34.923956 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 216/452] 10.222.0.16 () {60 vars in 1288 bytes} [Thu Jun 30 18:04:34 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 18:05:18.849587 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-97f17699-1063-4a6c-9c3d-3140fcbdd691 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:05:18.850168 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-97f17699-1063-4a6c-9c3d-3140fcbdd691 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:05:18.851986 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:05:18.852612 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=4 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:05:18.858935 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-97f17699-1063-4a6c-9c3d-3140fcbdd691 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:05:18.859373 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-97f17699-1063-4a6c-9c3d-3140fcbdd691 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:05:18.860116 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-97f17699-1063-4a6c-9c3d-3140fcbdd691 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:05:18.860580 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-97f17699-1063-4a6c-9c3d-3140fcbdd691 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:05:18.884956 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-97f17699-1063-4a6c-9c3d-3140fcbdd691 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033/ips" status: 200 len: 145 microversion: 2.1 time: 0.039395 Jun 30 18:05:18.885506 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 237/453] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 18:05:18 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:06:17.014990 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 30 18:06:17.015513 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:06:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:06:19.168176 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:06:19.168727 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:06:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:06:22.532732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:06:22.533328 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:06:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:06:26.235193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:06:26.235723 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:06:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:06:38.427895 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:06:38.428508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:07:05.736542 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:07:05.737111 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:08:10.011682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 30 18:08:10.012277 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:08:10.012838 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=4 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:08:10.017112 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1504457a-a290-4ef7-aa0e-4936c937ec0e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:08:10.018223 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1504457a-a290-4ef7-aa0e-4936c937ec0e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:08:10.025092 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1504457a-a290-4ef7-aa0e-4936c937ec0e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:08:10.025566 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1504457a-a290-4ef7-aa0e-4936c937ec0e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:08:10.026943 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1504457a-a290-4ef7-aa0e-4936c937ec0e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:08:10.027386 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1504457a-a290-4ef7-aa0e-4936c937ec0e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:08:10.052032 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1504457a-a290-4ef7-aa0e-4936c937ec0e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:08:10.134361 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1504457a-a290-4ef7-aa0e-4936c937ec0e tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 204 len: 0 microversion: 2.1 time: 0.124646 Jun 30 18:08:10.135133 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 217/454] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:08:10 2022] DELETE /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:08:10.143790 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4c43c087-cc50-4dcb-a478-7205a32020fc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:08:10.144390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4c43c087-cc50-4dcb-a478-7205a32020fc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:08:10.146519 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:08:10.147234 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=4 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:08:10.153002 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4c43c087-cc50-4dcb-a478-7205a32020fc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:08:10.153440 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4c43c087-cc50-4dcb-a478-7205a32020fc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:08:10.154187 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4c43c087-cc50-4dcb-a478-7205a32020fc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:08:10.154802 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4c43c087-cc50-4dcb-a478-7205a32020fc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:08:10.430196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4c43c087-cc50-4dcb-a478-7205a32020fc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:08:10.438133 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4c43c087-cc50-4dcb-a478-7205a32020fc tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1555 microversion: 2.1 time: 0.298721 Jun 30 18:08:10.438715 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 238/455] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:08:10 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1555 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:08:11.455896 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7acbbda1-08e3-4f72-8cf9-6f5d26eca497 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:08:11.456587 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7acbbda1-08e3-4f72-8cf9-6f5d26eca497 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:08:11.467704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7acbbda1-08e3-4f72-8cf9-6f5d26eca497 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:08:11.468156 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7acbbda1-08e3-4f72-8cf9-6f5d26eca497 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:08:11.468919 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7acbbda1-08e3-4f72-8cf9-6f5d26eca497 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:08:11.469388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7acbbda1-08e3-4f72-8cf9-6f5d26eca497 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:08:11.473683 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52916. Jun 30 18:08:11.558856 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-33b97383-09bd-4012-87ff-8c9cf55e9b8e req-470d2e2a-54c6-4ec9-bca8-5f73e65cb8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c800e3f-1e79-43c4-8013-a39d55cf9749", "name": "network-vif-deleted", "tag": "4dfdbd60-095f-4a21-9462-858c1e0777b8"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:08:11.569703 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-33b97383-09bd-4012-87ff-8c9cf55e9b8e req-470d2e2a-54c6-4ec9-bca8-5f73e65cb8ae service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:08:11.570135 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-33b97383-09bd-4012-87ff-8c9cf55e9b8e req-470d2e2a-54c6-4ec9-bca8-5f73e65cb8ae service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:08:11.583871 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-33b97383-09bd-4012-87ff-8c9cf55e9b8e req-470d2e2a-54c6-4ec9-bca8-5f73e65cb8ae service nova] Creating event network-vif-deleted:4dfdbd60-095f-4a21-9462-858c1e0777b8 for instance 2c800e3f-1e79-43c4-8013-a39d55cf9749 on hv-cinder-81268 Jun 30 18:08:11.592265 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-33b97383-09bd-4012-87ff-8c9cf55e9b8e req-470d2e2a-54c6-4ec9-bca8-5f73e65cb8ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037724 Jun 30 18:08:11.593030 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 239/456] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:08:11.595111 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7acbbda1-08e3-4f72-8cf9-6f5d26eca497 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0021d731c3344934b33b5ed2b35284be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4beb48dfc14400b1872c2930ea1e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:08:11.602714 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7acbbda1-08e3-4f72-8cf9-6f5d26eca497 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 200 len: 1513 microversion: 2.1 time: 0.150994 Jun 30 18:08:11.603259 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 218/457] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:08:11 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:08:12.618903 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:08:12.619590 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] [instance: 2c800e3f-1e79-43c4-8013-a39d55cf9749] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:08:12.626233 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:08:12.626701 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:08:12.627472 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:08:12.627900 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:08:12.641581 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] HTTP exception thrown: Instance 2c800e3f-1e79-43c4-8013-a39d55cf9749 could not be found. Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Request method failure captured: Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 HTTP/1.1 Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveNCBNjqRJtuTe9C1gSuXTBt04VdPsIDDVex5Vu5CvdL8sxh_g3dEZwUqkSGf8ZrxQCv8-9LMNarlwXzVk9fRDVtIEK0IHDoAujGHBR473VWnVj0At8CQcv_OjkTNp2eGpjB6XpSm_LAhR75DGHpsLdHRvTbaMNLnO0mtvF_l6CCs8g Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 6a4beb48dfc14400b1872c2930ea1e11 Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-TestMinimumBasicScenario-409256449 Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:08:12.643255 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6a4beb48dfc14400b1872c2930ea1e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6a4beb48dfc14400b1872c2930ea1e11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a4beb48dfc14400b1872c2930ea1e11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6a4beb48dfc14400b1872c2930ea1e11"}]}] Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-TestMinimumBasicScenario-409256449 Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 6a4beb48dfc14400b1872c2930ea1e11 Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-TestMinimumBasicScenario-409256449 Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-TestMinimumBasicScenario-409256449-project Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 0021d731c3344934b33b5ed2b35284be Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-TestMinimumBasicScenario-409256449-project Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 2c800e3f-1e79-43c4-8013-a39d55cf9749 could not be found. Jun 30 18:08:12.644944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '2c800e3f-1e79-43c4-8013-a39d55cf9749'} Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c800e3f-1e79-43c4-8013-a39d55cf9749 could not be found. Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:08:12.645812 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c800e3f-1e79-43c4-8013-a39d55cf9749 could not be found. Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c800e3f-1e79-43c4-8013-a39d55cf9749 could not be found. Jun 30 18:08:12.647159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:08:12.648336 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Returning 404 to user: Instance 2c800e3f-1e79-43c4-8013-a39d55cf9749 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:08:12.648336 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-624231f9-1534-4e88-9f31-5b313f6728b4 tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749" status: 404 len: 111 microversion: 2.1 time: 0.029880 Jun 30 18:08:12.648336 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 240/458] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:08:12 2022] GET /compute/v2.1/servers/2c800e3f-1e79-43c4-8013-a39d55cf9749 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:08:12.653091 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-9f1a5f04-19f9-4a2a-8732-af992e44290f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] Calling method '.version_select at 0x7f8f3c2da790>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:08:12.672985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-9f1a5f04-19f9-4a2a-8732-af992e44290f tempest-TestMinimumBasicScenario-409256449 tempest-TestMinimumBasicScenario-409256449-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-946586470" status: 202 len: 0 microversion: 2.1 time: 0.023571 Jun 30 18:08:12.673537 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 219/459] 10.222.0.16 () {58 vars in 1268 bytes} [Thu Jun 30 18:08:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-946586470 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:09:39.176091 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:09:39.176696 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:09:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:09:42.542044 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:09:42.542632 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:09:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:09:46.245393 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:09:46.245938 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:09:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:10:34.004696 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ff4cf949-7528-4bc9-971d-5f2f93fe9f64 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:34.005292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ff4cf949-7528-4bc9-971d-5f2f93fe9f64 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:34.007210 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=6 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:10:34.007851 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=10 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:10:34.015238 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ff4cf949-7528-4bc9-971d-5f2f93fe9f64 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:34.015683 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ff4cf949-7528-4bc9-971d-5f2f93fe9f64 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:34.016455 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ff4cf949-7528-4bc9-971d-5f2f93fe9f64 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:34.016888 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ff4cf949-7528-4bc9-971d-5f2f93fe9f64 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:34.046292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ff4cf949-7528-4bc9-971d-5f2f93fe9f64 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Going to try to terminate instance {{(pid=129370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:10:34.125959 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ff4cf949-7528-4bc9-971d-5f2f93fe9f64 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 204 len: 0 microversion: 2.1 time: 0.125046 Jun 30 18:10:34.126570 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 241/460] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:10:33 2022] DELETE /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:10:34.133344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 30 18:10:34.133947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:10:34.134823 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:10:34.138927 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ca7162e4-7f58-46d8-b51b-240392d4b769 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:34.139557 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ca7162e4-7f58-46d8-b51b-240392d4b769 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:34.147680 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca7162e4-7f58-46d8-b51b-240392d4b769 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:34.148388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca7162e4-7f58-46d8-b51b-240392d4b769 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:34.149166 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca7162e4-7f58-46d8-b51b-240392d4b769 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:34.149691 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca7162e4-7f58-46d8-b51b-240392d4b769 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:34.285563 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ca7162e4-7f58-46d8-b51b-240392d4b769 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:34.293813 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ca7162e4-7f58-46d8-b51b-240392d4b769 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1678 microversion: 2.1 time: 0.162420 Jun 30 18:10:34.294490 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 220/461] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:34 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:10:35.312049 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-324fe6da-9db4-43a9-ab5f-d561bfb0384e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:35.312780 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-324fe6da-9db4-43a9-ab5f-d561bfb0384e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:35.319021 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-324fe6da-9db4-43a9-ab5f-d561bfb0384e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:35.319466 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-324fe6da-9db4-43a9-ab5f-d561bfb0384e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:35.320227 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-324fe6da-9db4-43a9-ab5f-d561bfb0384e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:35.320658 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-324fe6da-9db4-43a9-ab5f-d561bfb0384e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:35.387289 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-f3a6105f-2af0-4735-a25a-4b28cb12ff70 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:35.387864 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-f3a6105f-2af0-4735-a25a-4b28cb12ff70 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:35.395200 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f3a6105f-2af0-4735-a25a-4b28cb12ff70 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:35.395655 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f3a6105f-2af0-4735-a25a-4b28cb12ff70 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:35.396427 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f3a6105f-2af0-4735-a25a-4b28cb12ff70 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:35.396865 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f3a6105f-2af0-4735-a25a-4b28cb12ff70 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:35.419687 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54708. Jun 30 18:10:35.425732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-f3a6105f-2af0-4735-a25a-4b28cb12ff70 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:10:35.506486 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-f3a6105f-2af0-4735-a25a-4b28cb12ff70 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 204 len: 0 microversion: 2.20 time: 0.122714 Jun 30 18:10:35.507070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 221/462] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jun 30 18:10:35 2022] DELETE /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 30 18:10:35.515878 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:35.516570 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:35.522658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:35.523110 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:35.523878 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:35.524315 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:35.540198 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-324fe6da-9db4-43a9-ab5f-d561bfb0384e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:35.550393 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-324fe6da-9db4-43a9-ab5f-d561bfb0384e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1678 microversion: 2.1 time: 0.242543 Jun 30 18:10:35.551280 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 242/463] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:35 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:10:35.672308 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:35.680316 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:35.681825 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:35.683282 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d91408a8-1b58-4a86-9482-caa5172c5bdb tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1723 microversion: 2.20 time: 0.171338 Jun 30 18:10:35.683835 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 222/464] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:10:35 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 18:10:36.283625 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-fb7b3670-4136-4108-b277-d2c73ce96343 req-6a6905eb-bc17-4471-afe0-17ea73893d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f69cd5f-ec69-4537-8a65-7f5325788f53", "name": "network-vif-deleted", "tag": "1dcba5a3-3d42-4153-b6ca-ae31aec9be1d"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:10:36.292926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-fb7b3670-4136-4108-b277-d2c73ce96343 req-6a6905eb-bc17-4471-afe0-17ea73893d9f service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:36.293669 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-fb7b3670-4136-4108-b277-d2c73ce96343 req-6a6905eb-bc17-4471-afe0-17ea73893d9f service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:36.306546 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-fb7b3670-4136-4108-b277-d2c73ce96343 req-6a6905eb-bc17-4471-afe0-17ea73893d9f service nova] Creating event network-vif-deleted:1dcba5a3-3d42-4153-b6ca-ae31aec9be1d for instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 on hv-cinder-81268 Jun 30 18:10:36.322930 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-fb7b3670-4136-4108-b277-d2c73ce96343 req-6a6905eb-bc17-4471-afe0-17ea73893d9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224993 Jun 30 18:10:36.324715 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 243/465] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:10:36.568033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:36.568656 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:36.575249 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:36.575702 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:36.576483 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:36.576921 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:36.612368 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:36.612883 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:36.613699 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.objects.instance [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lazy-loading 'fault' on Instance uuid 3f69cd5f-ec69-4537-8a65-7f5325788f53 {{(pid=129371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:10:36.660616 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:36.669190 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b1ecc731-e1ea-445c-9767-47353f146560 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 200 len: 1329 microversion: 2.1 time: 0.105039 Jun 30 18:10:36.672884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 223/466] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:36 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:36.704124 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:36.705046 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:36.712525 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:36.712903 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:36.713749 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:36.715025 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:36.977589 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:36.986005 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:36.987762 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:36.988995 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-036bb618-f7c6-48a3-ace4-235361a01544 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1723 microversion: 2.20 time: 0.291248 Jun 30 18:10:36.989966 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 244/467] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:10:36 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:10:37.687517 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:37.688127 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:37.695273 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:37.695721 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:37.696483 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:37.696918 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:37.711496 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] HTTP exception thrown: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Request method failure captured: Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 HTTP/1.1 Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL6FYylAQA5QUtIGY6-WeYVAJCtRDdyGdWxs5CjnPdannJc0DrRTjLsRDIxYwvU8oBpQLLugl0267HszgIUAgQ1uLB0677WnvU0KU4zCLRTz8p_PpddBX44P7RNaVsmiUu0Ehcgtd57WqIqL4h7WWj2Dm5HEkrtfidLTcAbgNyCWJY Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:10:37.717160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}] Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 2ed5e98a29c44296aeb921af4f521042 Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:10:37.719071 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '3f69cd5f-ec69-4537-8a65-7f5325788f53'} Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:10:37.720028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:10:37.721713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:10:37.723501 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Returning 404 to user: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:10:37.723501 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-007f8996-95bc-402e-b812-dfc507ef40c3 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 404 len: 111 microversion: 2.1 time: 0.035464 Jun 30 18:10:37.723501 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 224/468] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:37 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 18:10:37.727559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2d83f9eb-689c-4a75-be3d-17988eb8da3f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '.version_select at 0x7f8f3c2fd670>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:37.752598 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2d83f9eb-689c-4a75-be3d-17988eb8da3f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-6486464" status: 202 len: 0 microversion: 2.1 time: 0.028696 Jun 30 18:10:37.753925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 245/469] 10.222.0.16 () {58 vars in 1211 bytes} [Thu Jun 30 18:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-6486464 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 18:10:38.008129 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:38.008750 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:38.015606 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:38.016567 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:38.017644 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:38.018773 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:38.084751 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:38.085300 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:38.086821 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.objects.instance [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lazy-loading 'fault' on Instance uuid 7c8cca39-f0ac-4b38-af1c-6d192346d04b {{(pid=129371) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:10:38.136719 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:38.146830 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:38.148587 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63422b2e34eb479f972a181fb37f3608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed15171dff7466fab5d482c7fbb7b10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:38.150092 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a60b959c-f405-4bdc-b21b-e957a05c9d11 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 200 len: 1372 microversion: 2.20 time: 0.145738 Jun 30 18:10:38.162281 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 225/470] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:10:38 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 18:10:38.344868 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-6304931a-b2e0-4a46-8855-a443b38a0144 req-f04d959f-3a4f-41f0-8449-c4bf515d1424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8cca39-f0ac-4b38-af1c-6d192346d04b", "name": "network-vif-deleted", "tag": "5da3fc87-8ff5-4943-9aa7-f605b232bc96"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:10:38.353197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-6304931a-b2e0-4a46-8855-a443b38a0144 req-f04d959f-3a4f-41f0-8449-c4bf515d1424 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:38.353894 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-6304931a-b2e0-4a46-8855-a443b38a0144 req-f04d959f-3a4f-41f0-8449-c4bf515d1424 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:38.370826 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-6304931a-b2e0-4a46-8855-a443b38a0144 req-f04d959f-3a4f-41f0-8449-c4bf515d1424 service nova] Creating event network-vif-deleted:5da3fc87-8ff5-4943-9aa7-f605b232bc96 for instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b on hv-cinder-81268 Jun 30 18:10:38.376191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-6304931a-b2e0-4a46-8855-a443b38a0144 req-f04d959f-3a4f-41f0-8449-c4bf515d1424 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035328 Jun 30 18:10:38.377583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 246/471] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:10:38.602667 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-27c2e252-2bcc-46f8-94ca-295b88d013f4 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Action: 'create', calling method: .version_select at 0x7f8f3c29e9d0>, body: {"keypair": {"name": "tempest-keypair-1388264077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQdxefkcmvrvFJrCdqwpH9XWru7r/MKwQ3I3EC2YXHktFYVd4rOP82bnLPMspSbLrSJ/inx5PdmAdlOdqe+hpF/vxlz0H+oTJdFOl/D+4ElL+/GFf/nIVPu4QyrhvQLHg=="}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:10:38.619343 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-27c2e252-2bcc-46f8-94ca-295b88d013f4 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:10:38.623562 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-27c2e252-2bcc-46f8-94ca-295b88d013f4 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for user 2ed5e98a29c44296aeb921af4f521042 and project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:10:38.636310 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [None req-27c2e252-2bcc-46f8-94ca-295b88d013f4 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [53e92a86-79fb-4a29-a13f-151b6350a7a5] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:10:39.168935 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:39.169658 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:39.175944 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:39.176397 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:39.177150 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:39.177582 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:39.191077 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] HTTP exception thrown: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Request method failure captured: Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b HTTP/1.1 Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveL4rSlN6MGR1fDo5cBblF8rHaqntDflnX06he7Hy25rkmaA-RDOgLVIBFbMg9W7eb3lK7cD2k2DPib8F-uXIhHvGL7xcLbenCdnPyoxspG4_ktaDQnBtJeXLRFfsxtRTasEfPe6tIQjaiYE-rUktIi9-mpb_PVJCqVNqJrHh8tnaK8 Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:10:39.192926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}] Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 63422b2e34eb479f972a181fb37f3608 Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:10:39.194740 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '7c8cca39-f0ac-4b38-af1c-6d192346d04b'} Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:10:39.195608 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:10:39.196925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:10:39.198242 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Returning 404 to user: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:10:39.198242 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ae1d59c4-2b0a-4ebc-9d7e-b3cf6e72cd6c tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 404 len: 111 microversion: 2.20 time: 0.029676 Jun 30 18:10:39.198242 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 247/472] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:10:39 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 30 18:10:39.203485 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-736637a8-0c84-4746-977a-21eba88ea924 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '.version_select at 0x7f8f3c3a1040>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:39.221437 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-736637a8-0c84-4746-977a-21eba88ea924 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1104495435" status: 204 len: 0 microversion: 2.20 time: 0.021577 Jun 30 18:10:39.221996 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 248/473] 10.222.0.16 () {60 vars in 1261 bytes} [Thu Jun 30 18:10:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1104495435 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 18:10:39.643911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [None req-27c2e252-2bcc-46f8-94ca-295b88d013f4 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [53e92a86-79fb-4a29-a13f-151b6350a7a5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54780. Jun 30 18:10:39.660864 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-27c2e252-2bcc-46f8-94ca-295b88d013f4 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.062231 Jun 30 18:10:39.661638 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 226/474] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 18:10:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:10:41.019566 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-790628805", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "deee4646-f06a-4861-a34a-8d7afdbfbf09"}], "security_groups": [{"name": "tempest-securitygroup--1681739497"}], "key_name": "tempest-keypair-1388264077", "user_data": "}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:10:41.126516 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.network.neutron [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] validate_networks() for [('deee4646-f06a-4861-a34a-8d7afdbfbf09', None, None, None, None, None)] {{(pid=129370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:10:41.542930 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Flavor limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:10:41.543350 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Image limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:10:41.543818 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Flavor pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:10:41.544256 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Image pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:10:41.544659 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:10:41.553713 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:41.554174 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:41.554974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:41.555406 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:41.572814 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:10:41.576991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Getting quotas for user 2ed5e98a29c44296aeb921af4f521042 and project eacf1ab0e2244313b8f4f04d5d5202fa. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:10:41.588131 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Going to run 1 instances... {{(pid=129370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:10:41.590494 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:10:41.646907 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a05a851b-4383-4ddd-a1cc-5fc548796719 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.631431 Jun 30 18:10:41.647580 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 249/475] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:10:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:10:41.657888 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-f3c0d911-bf2d-4ba7-9eb3-e778a9415c44 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:41.658556 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-f3c0d911-bf2d-4ba7-9eb3-e778a9415c44 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:41.711531 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-f3c0d911-bf2d-4ba7-9eb3-e778a9415c44 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:41.718396 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-f3c0d911-bf2d-4ba7-9eb3-e778a9415c44 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1241 microversion: 2.1 time: 0.064637 Jun 30 18:10:41.718890 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 227/476] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:41 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:42.736240 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2968ef6d-388e-4b9b-bb3c-1ff834241ed0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:42.737061 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-2968ef6d-388e-4b9b-bb3c-1ff834241ed0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:42.745229 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2968ef6d-388e-4b9b-bb3c-1ff834241ed0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:42.745680 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2968ef6d-388e-4b9b-bb3c-1ff834241ed0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:42.746488 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2968ef6d-388e-4b9b-bb3c-1ff834241ed0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:42.746924 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2968ef6d-388e-4b9b-bb3c-1ff834241ed0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:42.834686 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2968ef6d-388e-4b9b-bb3c-1ff834241ed0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:42.842752 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2968ef6d-388e-4b9b-bb3c-1ff834241ed0 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1301 microversion: 2.1 time: 0.110663 Jun 30 18:10:42.843619 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 250/477] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:42 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:43.860110 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-aa408615-3253-4a02-8b43-d9c5cc54dea7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:43.861349 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-aa408615-3253-4a02-8b43-d9c5cc54dea7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:43.868132 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-aa408615-3253-4a02-8b43-d9c5cc54dea7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:43.868580 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-aa408615-3253-4a02-8b43-d9c5cc54dea7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:43.869338 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-aa408615-3253-4a02-8b43-d9c5cc54dea7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:43.869770 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-aa408615-3253-4a02-8b43-d9c5cc54dea7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:44.005904 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-aa408615-3253-4a02-8b43-d9c5cc54dea7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:44.015643 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-aa408615-3253-4a02-8b43-d9c5cc54dea7 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1367 microversion: 2.1 time: 0.159390 Jun 30 18:10:44.016492 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 228/478] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:43 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:44.262031 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-0b99d657-fdb0-4817-9fa0-44a99f10dbd9 req-4840eb42-756a-4826-a008-5344b8e4513d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d93f4ad-f4fd-4542-b0c1-d558283cc3e5", "tag": "ee4788b7-c177-4ee8-a780-d85d61dcc9e0"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:10:44.276714 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-0b99d657-fdb0-4817-9fa0-44a99f10dbd9 req-4840eb42-756a-4826-a008-5344b8e4513d service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:44.277355 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-0b99d657-fdb0-4817-9fa0-44a99f10dbd9 req-4840eb42-756a-4826-a008-5344b8e4513d service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:44.299731 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-0b99d657-fdb0-4817-9fa0-44a99f10dbd9 req-4840eb42-756a-4826-a008-5344b8e4513d service nova] Creating event network-changed:ee4788b7-c177-4ee8-a780-d85d61dcc9e0 for instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 on hv-cinder-81268 Jun 30 18:10:44.305508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-0b99d657-fdb0-4817-9fa0-44a99f10dbd9 req-4840eb42-756a-4826-a008-5344b8e4513d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049394 Jun 30 18:10:44.306663 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 251/479] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:10:45.032677 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7109a067-83ba-4642-adfa-42132da350c1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:45.033274 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7109a067-83ba-4642-adfa-42132da350c1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:45.039834 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7109a067-83ba-4642-adfa-42132da350c1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:45.040276 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7109a067-83ba-4642-adfa-42132da350c1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:45.041043 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7109a067-83ba-4642-adfa-42132da350c1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:45.041475 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7109a067-83ba-4642-adfa-42132da350c1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:45.166397 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7109a067-83ba-4642-adfa-42132da350c1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:45.173983 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7109a067-83ba-4642-adfa-42132da350c1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1367 microversion: 2.1 time: 0.145149 Jun 30 18:10:45.174593 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 229/480] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:45 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:46.191412 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-497151ae-9f38-439f-9141-c69a995c25f8 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:46.192393 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-497151ae-9f38-439f-9141-c69a995c25f8 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:46.199264 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-497151ae-9f38-439f-9141-c69a995c25f8 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:46.199704 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-497151ae-9f38-439f-9141-c69a995c25f8 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:46.200451 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-497151ae-9f38-439f-9141-c69a995c25f8 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:46.200878 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-497151ae-9f38-439f-9141-c69a995c25f8 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:46.330783 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-497151ae-9f38-439f-9141-c69a995c25f8 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:46.338574 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-497151ae-9f38-439f-9141-c69a995c25f8 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1367 microversion: 2.1 time: 0.151301 Jun 30 18:10:46.339194 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 252/481] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:46 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:47.359855 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-473b1b7f-5320-42d3-8c21-b7ae330ef755 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:47.360510 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-473b1b7f-5320-42d3-8c21-b7ae330ef755 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:47.367374 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-473b1b7f-5320-42d3-8c21-b7ae330ef755 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:47.367815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-473b1b7f-5320-42d3-8c21-b7ae330ef755 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:47.368581 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-473b1b7f-5320-42d3-8c21-b7ae330ef755 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:47.369014 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-473b1b7f-5320-42d3-8c21-b7ae330ef755 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:47.501729 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-473b1b7f-5320-42d3-8c21-b7ae330ef755 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:47.509042 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-473b1b7f-5320-42d3-8c21-b7ae330ef755 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1367 microversion: 2.1 time: 0.155207 Jun 30 18:10:47.509604 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 230/482] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:47 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:10:48.525646 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bfbdfbe7-78b8-409e-b5fe-ff04a3da15f1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:48.527010 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-bfbdfbe7-78b8-409e-b5fe-ff04a3da15f1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:48.534030 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bfbdfbe7-78b8-409e-b5fe-ff04a3da15f1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:48.534593 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bfbdfbe7-78b8-409e-b5fe-ff04a3da15f1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:48.535466 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bfbdfbe7-78b8-409e-b5fe-ff04a3da15f1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:48.536000 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bfbdfbe7-78b8-409e-b5fe-ff04a3da15f1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:48.668941 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-bfbdfbe7-78b8-409e-b5fe-ff04a3da15f1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:48.677485 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-bfbdfbe7-78b8-409e-b5fe-ff04a3da15f1 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1367 microversion: 2.1 time: 0.156376 Jun 30 18:10:48.678089 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 253/483] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:48 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:49.696614 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ede6b5ef-0f78-4191-a015-b172d3a8954c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:49.697221 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ede6b5ef-0f78-4191-a015-b172d3a8954c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:49.703771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ede6b5ef-0f78-4191-a015-b172d3a8954c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:49.704222 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ede6b5ef-0f78-4191-a015-b172d3a8954c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:49.704977 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ede6b5ef-0f78-4191-a015-b172d3a8954c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:49.705410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ede6b5ef-0f78-4191-a015-b172d3a8954c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:49.844776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ede6b5ef-0f78-4191-a015-b172d3a8954c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:49.852320 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ede6b5ef-0f78-4191-a015-b172d3a8954c tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1367 microversion: 2.1 time: 0.159876 Jun 30 18:10:49.852815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 231/484] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:49 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:50.353345 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-0633fb97-609c-4cf1-9ef4-28aa25a7e251 req-cb2aa569-364c-41d5-91aa-d99e49e5efaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d93f4ad-f4fd-4542-b0c1-d558283cc3e5", "name": "network-vif-plugged", "status": "completed", "tag": "ee4788b7-c177-4ee8-a780-d85d61dcc9e0"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:10:50.362062 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-0633fb97-609c-4cf1-9ef4-28aa25a7e251 req-cb2aa569-364c-41d5-91aa-d99e49e5efaf service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:50.362530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-0633fb97-609c-4cf1-9ef4-28aa25a7e251 req-cb2aa569-364c-41d5-91aa-d99e49e5efaf service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:50.373390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-0633fb97-609c-4cf1-9ef4-28aa25a7e251 req-cb2aa569-364c-41d5-91aa-d99e49e5efaf service nova] Creating event network-vif-plugged:ee4788b7-c177-4ee8-a780-d85d61dcc9e0 for instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 on hv-cinder-81268 Jun 30 18:10:50.378209 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-0633fb97-609c-4cf1-9ef4-28aa25a7e251 req-cb2aa569-364c-41d5-91aa-d99e49e5efaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102861 Jun 30 18:10:50.378807 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 254/485] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:10:50.870055 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6dac9306-32d6-40d9-839a-855a0327405a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:50.870940 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6dac9306-32d6-40d9-839a-855a0327405a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:50.878220 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6dac9306-32d6-40d9-839a-855a0327405a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:50.878802 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6dac9306-32d6-40d9-839a-855a0327405a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:50.879712 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6dac9306-32d6-40d9-839a-855a0327405a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:50.880270 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6dac9306-32d6-40d9-839a-855a0327405a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:51.023055 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6dac9306-32d6-40d9-839a-855a0327405a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:51.030626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6dac9306-32d6-40d9-839a-855a0327405a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1367 microversion: 2.1 time: 0.165114 Jun 30 18:10:51.031181 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 232/486] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:50 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:52.048708 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:10:52.050046 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=6 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:10:52.055100 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-da5df29b-e85e-4b7e-9c1b-07f17eec6c08 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:52.055925 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-da5df29b-e85e-4b7e-9c1b-07f17eec6c08 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:52.064959 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-da5df29b-e85e-4b7e-9c1b-07f17eec6c08 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:52.065512 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-da5df29b-e85e-4b7e-9c1b-07f17eec6c08 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:52.066451 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-da5df29b-e85e-4b7e-9c1b-07f17eec6c08 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:52.067207 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-da5df29b-e85e-4b7e-9c1b-07f17eec6c08 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:52.210825 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-da5df29b-e85e-4b7e-9c1b-07f17eec6c08 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:52.219073 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-da5df29b-e85e-4b7e-9c1b-07f17eec6c08 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1367 microversion: 2.1 time: 0.171422 Jun 30 18:10:52.219625 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 255/487] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:52 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:53.235862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0fccc6ac-0f30-407b-b633-cee336c33d87 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:53.236530 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0fccc6ac-0f30-407b-b633-cee336c33d87 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:53.238461 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=6 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:10:53.244188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fccc6ac-0f30-407b-b633-cee336c33d87 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:53.244633 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fccc6ac-0f30-407b-b633-cee336c33d87 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:53.245378 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fccc6ac-0f30-407b-b633-cee336c33d87 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:53.245833 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fccc6ac-0f30-407b-b633-cee336c33d87 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:53.378310 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0fccc6ac-0f30-407b-b633-cee336c33d87 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:10:53.385975 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0fccc6ac-0f30-407b-b633-cee336c33d87 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1556 microversion: 2.1 time: 0.153906 Jun 30 18:10:53.386611 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 233/488] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:10:53 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:10:53.402716 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6a5271dd-2e22-4c33-9e33-8ced89d635db tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:10:53.403276 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6a5271dd-2e22-4c33-9e33-8ced89d635db tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:10:53.409172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a5271dd-2e22-4c33-9e33-8ced89d635db tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:53.409609 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a5271dd-2e22-4c33-9e33-8ced89d635db tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:53.410368 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a5271dd-2e22-4c33-9e33-8ced89d635db tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:53.410798 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6a5271dd-2e22-4c33-9e33-8ced89d635db tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:53.495935 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6a5271dd-2e22-4c33-9e33-8ced89d635db tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097542 Jun 30 18:10:53.496514 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 256/489] 10.222.0.16 () {58 vars in 1274 bytes} [Thu Jun 30 18:10:53 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:10:54.432143 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-ed6139d2-e2d5-4358-bf1d-b23aa4a67ac0 req-a60da0a6-8dd3-4659-8d15-7f58dc878120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d93f4ad-f4fd-4542-b0c1-d558283cc3e5", "tag": "ee4788b7-c177-4ee8-a780-d85d61dcc9e0"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:10:54.442907 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-ed6139d2-e2d5-4358-bf1d-b23aa4a67ac0 req-a60da0a6-8dd3-4659-8d15-7f58dc878120 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:10:54.443347 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-ed6139d2-e2d5-4358-bf1d-b23aa4a67ac0 req-a60da0a6-8dd3-4659-8d15-7f58dc878120 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:10:54.461922 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-ed6139d2-e2d5-4358-bf1d-b23aa4a67ac0 req-a60da0a6-8dd3-4659-8d15-7f58dc878120 service nova] Creating event network-changed:ee4788b7-c177-4ee8-a780-d85d61dcc9e0 for instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 on hv-cinder-81268 Jun 30 18:10:54.468595 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-ed6139d2-e2d5-4358-bf1d-b23aa4a67ac0 req-a60da0a6-8dd3-4659-8d15-7f58dc878120 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040190 Jun 30 18:10:54.469425 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 234/490] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:11:19.318541 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:11:19.319293 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:11:19.323705 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b9d3a5ab-08af-4a4d-a7bc-d3a1c7168c97 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:11:19.324192 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b9d3a5ab-08af-4a4d-a7bc-d3a1c7168c97 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:11:19.332133 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b9d3a5ab-08af-4a4d-a7bc-d3a1c7168c97 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:11:19.332577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b9d3a5ab-08af-4a4d-a7bc-d3a1c7168c97 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:11:19.333341 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b9d3a5ab-08af-4a4d-a7bc-d3a1c7168c97 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:11:19.333771 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b9d3a5ab-08af-4a4d-a7bc-d3a1c7168c97 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:11:19.362270 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b9d3a5ab-08af-4a4d-a7bc-d3a1c7168c97 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Going to try to terminate instance {{(pid=129370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:11:19.442571 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b9d3a5ab-08af-4a4d-a7bc-d3a1c7168c97 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 204 len: 0 microversion: 2.1 time: 0.124395 Jun 30 18:11:19.443174 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 257/491] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:11:19 2022] DELETE /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:11:19.449887 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:11:19.451787 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:11:19.456503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2a681643-be1c-47dd-89a2-987abf68266e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:11:19.457252 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2a681643-be1c-47dd-89a2-987abf68266e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:11:19.464429 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2a681643-be1c-47dd-89a2-987abf68266e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:11:19.465145 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2a681643-be1c-47dd-89a2-987abf68266e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:11:19.465917 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2a681643-be1c-47dd-89a2-987abf68266e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:11:19.466368 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2a681643-be1c-47dd-89a2-987abf68266e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:11:19.600042 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2a681643-be1c-47dd-89a2-987abf68266e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:11:19.608455 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2a681643-be1c-47dd-89a2-987abf68266e tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1674 microversion: 2.1 time: 0.160190 Jun 30 18:11:19.609573 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 235/492] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:11:19 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:11:20.626139 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6e8a8ed3-28cf-42c8-ac3e-ca02947de83d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:11:20.627500 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6e8a8ed3-28cf-42c8-ac3e-ca02947de83d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:11:20.634110 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6e8a8ed3-28cf-42c8-ac3e-ca02947de83d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:11:20.635123 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6e8a8ed3-28cf-42c8-ac3e-ca02947de83d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:11:20.635915 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6e8a8ed3-28cf-42c8-ac3e-ca02947de83d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:11:20.636339 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6e8a8ed3-28cf-42c8-ac3e-ca02947de83d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:11:20.895912 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6e8a8ed3-28cf-42c8-ac3e-ca02947de83d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de0ef30352514ef9bb4559473e096ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221481e35182443995ea17136383f6f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:11:20.904391 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6e8a8ed3-28cf-42c8-ac3e-ca02947de83d tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 200 len: 1674 microversion: 2.1 time: 0.282762 Jun 30 18:11:20.904988 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 258/493] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:11:20 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 1674 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:11:21.089360 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-8d4c54b6-4cdf-4f3e-8490-30615897f334 req-c0db8aa1-4d65-4146-a96e-5f5c48e67e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33741f52-1148-4d99-ae73-49c3af917033", "name": "network-vif-deleted", "tag": "bd44f027-e47c-4b7a-9868-8b92b116233a"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:11:21.098845 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-8d4c54b6-4cdf-4f3e-8490-30615897f334 req-c0db8aa1-4d65-4146-a96e-5f5c48e67e30 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:11:21.099604 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-8d4c54b6-4cdf-4f3e-8490-30615897f334 req-c0db8aa1-4d65-4146-a96e-5f5c48e67e30 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:11:21.113638 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-8d4c54b6-4cdf-4f3e-8490-30615897f334 req-c0db8aa1-4d65-4146-a96e-5f5c48e67e30 service nova] Creating event network-vif-deleted:bd44f027-e47c-4b7a-9868-8b92b116233a for instance 33741f52-1148-4d99-ae73-49c3af917033 on hv-cinder-81268 Jun 30 18:11:21.119270 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-8d4c54b6-4cdf-4f3e-8490-30615897f334 req-c0db8aa1-4d65-4146-a96e-5f5c48e67e30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041342 Jun 30 18:11:21.120237 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 236/494] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:11:21.922220 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:11:21.922970 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:11:21.930045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:11:21.930527 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:11:21.931295 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:11:21.931727 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:11:21.949859 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] HTTP exception thrown: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Request method failure captured: Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 HTTP/1.1 Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveO8_DJNnIYx8_lK_AvekTa_Ex0d3B8UPO_hZX1TCze0KzPLX6UQkEZzpZrLXmWYXGRyRKwlh1-SjLvhidEcgaSSXtAFNHY7Ksf05TeDBhBUCEz_-Vm-0q6z0e00YDL891uTA5qwWDA4WNUa4s-uy6AkJ8Duru_qHD0TAr9m5ZYYqwo Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:11:21.951583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/221481e35182443995ea17136383f6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_221481e35182443995ea17136383f6f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}] Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: de0ef30352514ef9bb4559473e096ea6 Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:11:21.953137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '33741f52-1148-4d99-ae73-49c3af917033'} Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:11:21.954045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:11:21.960653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:11:21.961975 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Returning 404 to user: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:11:21.961975 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c36d9805-2135-4d8a-91f1-c28b75aedf72 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 404 len: 111 microversion: 2.1 time: 0.034958 Jun 30 18:11:21.961975 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 259/495] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:11:21 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:11:21.963827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-57d30746-6ad6-4825-bf78-be68bfcb4d7f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '.version_select at 0x7f8f3c2bab80>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:11:21.986567 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-57d30746-6ad6-4825-bf78-be68bfcb4d7f tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357535986" status: 202 len: 0 microversion: 2.1 time: 0.027942 Jun 30 18:11:21.987479 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 237/496] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jun 30 18:11:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357535986 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 18:12:09.650935 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-338c3894-6d2b-4303-ad30-b4a151a399ee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:12:09.651541 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-338c3894-6d2b-4303-ad30-b4a151a399ee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:12:09.653479 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:12:09.654115 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:12:09.661153 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-338c3894-6d2b-4303-ad30-b4a151a399ee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:12:09.661600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-338c3894-6d2b-4303-ad30-b4a151a399ee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:12:09.662392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-338c3894-6d2b-4303-ad30-b4a151a399ee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:12:09.662829 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-338c3894-6d2b-4303-ad30-b4a151a399ee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:12:09.689831 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-338c3894-6d2b-4303-ad30-b4a151a399ee tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5/ips" status: 200 len: 148 microversion: 2.1 time: 0.043278 Jun 30 18:12:09.690441 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 260/497] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 18:12:09 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:13:02.550455 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:13:02.551106 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:13:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:13:06.253649 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:13:06.254220 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:13:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:14:37.027823 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:14:37.028488 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:16:19.189421 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:16:19.190060 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:16:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:16:22.561251 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:16:22.561821 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:16:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:16:26.266921 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:16:26.267436 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:16:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:16:38.442703 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:16:38.443406 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:16:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:16:40.002317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:16:40.003064 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=8 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:16:40.003592 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:16:40.007728 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:16:40.008342 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:16:40.016999 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:16:40.017446 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:16:40.018243 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:16:40.018722 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:16:40.032280 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] HTTP exception thrown: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Request method failure captured: Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: DELETE /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b HTTP/1.1 Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL4rSlN6MGR1fDo5cBblF8rHaqntDflnX06he7Hy25rkmaA-RDOgLVIBFbMg9W7eb3lK7cD2k2DPib8F-uXIhHvGL7xcLbenCdnPyoxspG4_ktaDQnBtJeXLRFfsxtRTasEfPe6tIQjaiYE-rUktIi9-mpb_PVJCqVNqJrHh8tnaK8 Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:16:40.033899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}] Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 63422b2e34eb479f972a181fb37f3608 Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.036122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '7c8cca39-f0ac-4b38-af1c-6d192346d04b'} Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:16:40.037159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.039218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.040947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Returning 404 to user: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:16:40.040947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-76fd884f-f642-4ea1-8b6b-b10721b74137 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 404 len: 111 microversion: 2.20 time: 0.035918 Jun 30 18:16:40.040947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 238/498] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jun 30 18:16:39 2022] DELETE /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:16:40.041505 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:16:40.042235 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=4 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:16:40.046189 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:16:40.047323 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: 7c8cca39-f0ac-4b38-af1c-6d192346d04b] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:16:40.054927 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:16:40.055369 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:16:40.056116 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:16:40.056546 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:16:40.070706 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] HTTP exception thrown: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Request method failure captured: Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b HTTP/1.1 Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveL4rSlN6MGR1fDo5cBblF8rHaqntDflnX06he7Hy25rkmaA-RDOgLVIBFbMg9W7eb3lK7cD2k2DPib8F-uXIhHvGL7xcLbenCdnPyoxspG4_ktaDQnBtJeXLRFfsxtRTasEfPe6tIQjaiYE-rUktIi9-mpb_PVJCqVNqJrHh8tnaK8 Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:16:40.072247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}] Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 63422b2e34eb479f972a181fb37f3608 Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.073940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '7c8cca39-f0ac-4b38-af1c-6d192346d04b'} Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:16:40.074839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. Jun 30 18:16:40.076197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:16:40.077546 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Returning 404 to user: Instance 7c8cca39-f0ac-4b38-af1c-6d192346d04b could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:16:40.077546 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-7b9537be-3aa0-41c6-8a3c-0e14b17452e6 tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b" status: 404 len: 111 microversion: 2.20 time: 0.033717 Jun 30 18:16:40.077546 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 261/499] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:16:40 2022] GET /compute/v2.1/servers/7c8cca39-f0ac-4b38-af1c-6d192346d04b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:17:05.751493 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:17:05.751981 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:17:22.926530 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:17:22.927160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:17:22.930218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:17:22.931163 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:17:22.944136 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:17:22.944589 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:17:22.945361 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:17:22.945796 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:17:22.951882 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 58488. Jun 30 18:17:22.961865 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] HTTP exception thrown: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Request method failure captured: Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: DELETE /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 HTTP/1.1 Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveO8_DJNnIYx8_lK_AvekTa_Ex0d3B8UPO_hZX1TCze0KzPLX6UQkEZzpZrLXmWYXGRyRKwlh1-SjLvhidEcgaSSXtAFNHY7Ksf05TeDBhBUCEz_-Vm-0q6z0e00YDL891uTA5qwWDA4WNUa4s-uy6AkJ8Duru_qHD0TAr9m5ZYYqwo Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:17:22.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/221481e35182443995ea17136383f6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_221481e35182443995ea17136383f6f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}] Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: de0ef30352514ef9bb4559473e096ea6 Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:22.965109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '33741f52-1148-4d99-ae73-49c3af917033'} Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:17:22.966451 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:22.968246 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:17:22.970034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Returning 404 to user: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:17:22.970034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-c52e5521-67c5-4c00-84a2-b3398ae3ef8a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 404 len: 111 microversion: 2.1 time: 0.042132 Jun 30 18:17:22.970034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 239/500] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:17:22 2022] DELETE /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:17:22.975250 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:17:22.975857 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 33741f52-1148-4d99-ae73-49c3af917033] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:17:22.977745 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:17:22.978405 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:17:22.984462 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:17:22.984888 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:17:22.985681 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:17:22.986107 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:17:23.000033 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] HTTP exception thrown: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Request method failure captured: Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 HTTP/1.1 Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveO8_DJNnIYx8_lK_AvekTa_Ex0d3B8UPO_hZX1TCze0KzPLX6UQkEZzpZrLXmWYXGRyRKwlh1-SjLvhidEcgaSSXtAFNHY7Ksf05TeDBhBUCEz_-Vm-0q6z0e00YDL891uTA5qwWDA4WNUa4s-uy6AkJ8Duru_qHD0TAr9m5ZYYqwo Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:17:23.002082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/221481e35182443995ea17136383f6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_221481e35182443995ea17136383f6f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}] Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: de0ef30352514ef9bb4559473e096ea6 Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:23.003885 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '33741f52-1148-4d99-ae73-49c3af917033'} Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:17:23.004897 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. Jun 30 18:17:23.006530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:17:23.008066 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Returning 404 to user: Instance 33741f52-1148-4d99-ae73-49c3af917033 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:17:23.008066 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3b8ac5e9-473a-44b2-841d-785bfa437bea tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033" status: 404 len: 111 microversion: 2.1 time: 0.032070 Jun 30 18:17:23.008066 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 262/501] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:17:22 2022] GET /compute/v2.1/servers/33741f52-1148-4d99-ae73-49c3af917033 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:17:57.040523 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:17:57.041005 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:17:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:18:09.893043 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ed721e23-d0df-44cf-bfdb-d8d866102b47 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:18:09.894054 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ed721e23-d0df-44cf-bfdb-d8d866102b47 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:18:09.896282 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:18:09.896920 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:18:09.903519 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ed721e23-d0df-44cf-bfdb-d8d866102b47 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:18:09.903973 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ed721e23-d0df-44cf-bfdb-d8d866102b47 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:18:09.904766 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ed721e23-d0df-44cf-bfdb-d8d866102b47 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:18:09.905201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ed721e23-d0df-44cf-bfdb-d8d866102b47 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:18:09.933115 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ed721e23-d0df-44cf-bfdb-d8d866102b47 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:18:10.023823 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ed721e23-d0df-44cf-bfdb-d8d866102b47 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 204 len: 0 microversion: 2.1 time: 0.134599 Jun 30 18:18:10.024547 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 240/502] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:18:09 2022] DELETE /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:18:10.034249 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-cbbb94ba-7be0-4978-9ff6-6006ba714a30 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:18:10.034910 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-cbbb94ba-7be0-4978-9ff6-6006ba714a30 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:18:10.036916 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:18:10.037558 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:18:10.043698 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cbbb94ba-7be0-4978-9ff6-6006ba714a30 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:18:10.044469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cbbb94ba-7be0-4978-9ff6-6006ba714a30 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:18:10.045762 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cbbb94ba-7be0-4978-9ff6-6006ba714a30 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:18:10.046547 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cbbb94ba-7be0-4978-9ff6-6006ba714a30 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:18:10.316998 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-cbbb94ba-7be0-4978-9ff6-6006ba714a30 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:18:10.324459 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-cbbb94ba-7be0-4978-9ff6-6006ba714a30 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1680 microversion: 2.1 time: 0.295334 Jun 30 18:18:10.325014 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 263/503] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:18:10 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1680 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:18:11.342645 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d0708403-eeab-46a1-86c3-ebc7fbd8ecbd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:18:11.343349 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d0708403-eeab-46a1-86c3-ebc7fbd8ecbd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:18:11.349688 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d0708403-eeab-46a1-86c3-ebc7fbd8ecbd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:18:11.350150 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d0708403-eeab-46a1-86c3-ebc7fbd8ecbd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:18:11.350959 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d0708403-eeab-46a1-86c3-ebc7fbd8ecbd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:18:11.351401 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d0708403-eeab-46a1-86c3-ebc7fbd8ecbd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:18:11.570817 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d0708403-eeab-46a1-86c3-ebc7fbd8ecbd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5e98a29c44296aeb921af4f521042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacf1ab0e2244313b8f4f04d5d5202fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:18:11.584215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d0708403-eeab-46a1-86c3-ebc7fbd8ecbd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 200 len: 1612 microversion: 2.1 time: 0.245394 Jun 30 18:18:11.585228 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 241/504] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:18:11 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 1612 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:18:12.127280 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-fff87d0b-41a4-46a2-b1b2-abc822c4afc4 req-17935a72-0266-4dee-b495-8dd0c55f53e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d93f4ad-f4fd-4542-b0c1-d558283cc3e5", "name": "network-vif-deleted", "tag": "ee4788b7-c177-4ee8-a780-d85d61dcc9e0"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:18:12.141673 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-fff87d0b-41a4-46a2-b1b2-abc822c4afc4 req-17935a72-0266-4dee-b495-8dd0c55f53e8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:18:12.142494 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-fff87d0b-41a4-46a2-b1b2-abc822c4afc4 req-17935a72-0266-4dee-b495-8dd0c55f53e8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:18:12.164692 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-fff87d0b-41a4-46a2-b1b2-abc822c4afc4 req-17935a72-0266-4dee-b495-8dd0c55f53e8 service nova] Creating event network-vif-deleted:ee4788b7-c177-4ee8-a780-d85d61dcc9e0 for instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 on hv-cinder-81268 Jun 30 18:18:12.171874 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-fff87d0b-41a4-46a2-b1b2-abc822c4afc4 req-17935a72-0266-4dee-b495-8dd0c55f53e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158351 Jun 30 18:18:12.172470 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 264/505] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:18:12.603235 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:18:12.603763 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:18:12.610947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:18:12.611411 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:18:12.612189 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:18:12.612633 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:18:12.627196 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] HTTP exception thrown: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Request method failure captured: Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 HTTP/1.1 Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL6FYylAQA5QUtIGY6-WeYVAJCtRDdyGdWxs5CjnPdannJc0DrRTjLsRDIxYwvU8oBpQLLugl0267HszgIUAgQ1uLB0677WnvU0KU4zCLRTz8p_PpddBX44P7RNaVsmiUu0Ehcgtd57WqIqL4h7WWj2Dm5HEkrtfidLTcAbgNyCWJY Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:18:12.628851 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}] Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 2ed5e98a29c44296aeb921af4f521042 Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:18:12.630201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '0d93f4ad-f4fd-4542-b0c1-d558283cc3e5'} Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:18:12.631033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:18:12.632453 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:18:12.633523 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Returning 404 to user: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:18:12.633523 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5b04bab2-475f-4b09-a04a-fe33fe52a15e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 404 len: 111 microversion: 2.1 time: 0.031087 Jun 30 18:18:12.634223 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 242/506] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:18:12 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:18:12.640243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3af9c889-e40b-4b3c-811a-82c822feb80a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '.version_select at 0x7f8f3c2a4e50>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:18:12.663838 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3af9c889-e40b-4b3c-811a-82c822feb80a tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388264077" status: 202 len: 0 microversion: 2.1 time: 0.027589 Jun 30 18:18:12.664423 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 265/507] 10.222.0.16 () {58 vars in 1220 bytes} [Thu Jun 30 18:18:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388264077 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:19:42.571469 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:19:42.572010 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:19:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:19:46.274595 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:19:46.275114 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:19:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:21:17.048813 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:21:17.049267 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:21:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:21:19.199196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:21:19.199682 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:21:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:22:40.084744 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 30 18:22:40.085563 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:22:40.088002 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:22:40.090817 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:40.091324 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:22:40.101257 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:22:40.101761 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:22:40.103305 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:22:40.103767 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:22:40.121254 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] HTTP exception thrown: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Request method failure captured: Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: DELETE /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf HTTP/1.1 Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL4rSlN6MGR1fDo5cBblF8rHaqntDflnX06he7Hy25rkmaA-RDOgLVIBFbMg9W7eb3lK7cD2k2DPib8F-uXIhHvGL7xcLbenCdnPyoxspG4_ktaDQnBtJeXLRFfsxtRTasEfPe6tIQjaiYE-rUktIi9-mpb_PVJCqVNqJrHh8tnaK8 Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:22:40.122861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}] Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 63422b2e34eb479f972a181fb37f3608 Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.124388 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': 'ced4f642-e357-49ac-abac-c606c2e747bf'} Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:22:40.125326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.127193 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.128807 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Returning 404 to user: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:22:40.128807 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-50158b7f-96d8-47cf-a4b1-3435251a975e tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 404 len: 111 microversion: 2.20 time: 0.041680 Jun 30 18:22:40.128807 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 243/508] 10.222.0.16 () {60 vars in 1279 bytes} [Thu Jun 30 18:22:40 2022] DELETE /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:22:40.131504 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=8 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:22:40.132272 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:22:40.138954 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:22:40.139461 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] [instance: ced4f642-e357-49ac-abac-c606c2e747bf] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:22:40.148258 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:22:40.148926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:22:40.149721 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:22:40.150164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:22:40.166141 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] HTTP exception thrown: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Request method failure captured: Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf HTTP/1.1 Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveL4rSlN6MGR1fDo5cBblF8rHaqntDflnX06he7Hy25rkmaA-RDOgLVIBFbMg9W7eb3lK7cD2k2DPib8F-uXIhHvGL7xcLbenCdnPyoxspG4_ktaDQnBtJeXLRFfsxtRTasEfPe6tIQjaiYE-rUktIi9-mpb_PVJCqVNqJrHh8tnaK8 Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:22:40.167917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2ed15171dff7466fab5d482c7fbb7b10"}]}] Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 2ed15171dff7466fab5d482c7fbb7b10 Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1359452659 Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 63422b2e34eb479f972a181fb37f3608 Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1359452659-project Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.169346 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': 'ced4f642-e357-49ac-abac-c606c2e747bf'} Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:22:40.170064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. Jun 30 18:22:40.171243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:22:40.172739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] Returning 404 to user: Instance ced4f642-e357-49ac-abac-c606c2e747bf could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:22:40.172739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3a3d71d1-ab36-43b7-b192-19e0bc9f220f tempest-AttachVolumeShelveTestJSON-1359452659 tempest-AttachVolumeShelveTestJSON-1359452659-project] 10.222.0.16 "GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf" status: 404 len: 111 microversion: 2.20 time: 0.039062 Jun 30 18:22:40.172739 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 266/509] 10.222.0.16 () {60 vars in 1276 bytes} [Thu Jun 30 18:22:40 2022] GET /compute/v2.1/servers/ced4f642-e357-49ac-abac-c606c2e747bf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 18:23:02.581508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:23:02.582135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:23:06.284419 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:23:06.285209 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:23:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:23:18.453888 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:23:18.456550 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:23:23.470782 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:23:23.471713 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:23:23.476254 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:23:23.477440 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:23:23.493134 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:23:23.493931 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:23:23.495417 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:23:23.496200 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:23:23.497853 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33216. Jun 30 18:23:23.525608 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] HTTP exception thrown: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Request method failure captured: Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: DELETE /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 HTTP/1.1 Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveO8_DJNnIYx8_lK_AvekTa_Ex0d3B8UPO_hZX1TCze0KzPLX6UQkEZzpZrLXmWYXGRyRKwlh1-SjLvhidEcgaSSXtAFNHY7Ksf05TeDBhBUCEz_-Vm-0q6z0e00YDL891uTA5qwWDA4WNUa4s-uy6AkJ8Duru_qHD0TAr9m5ZYYqwo Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:23:23.528689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/221481e35182443995ea17136383f6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_221481e35182443995ea17136383f6f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}] Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: de0ef30352514ef9bb4559473e096ea6 Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.530926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '14cea2ce-a906-4967-8453-71e73efd83b3'} Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:23:23.532097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.534626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.537285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Returning 404 to user: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:23:23.537285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-101b062d-eec7-4e6c-acd0-cb37025bae46 tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "DELETE /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 404 len: 111 microversion: 2.1 time: 0.067727 Jun 30 18:23:23.537285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 244/510] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:23:23 2022] DELETE /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:23:23.542276 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:23:23.542934 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] [instance: 14cea2ce-a906-4967-8453-71e73efd83b3] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:23:23.545277 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:23:23.545950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:23:23.553471 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:23:23.554044 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:23:23.554879 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:23:23.555324 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:23:23.577468 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] HTTP exception thrown: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Request method failure captured: Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 HTTP/1.1 Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveO8_DJNnIYx8_lK_AvekTa_Ex0d3B8UPO_hZX1TCze0KzPLX6UQkEZzpZrLXmWYXGRyRKwlh1-SjLvhidEcgaSSXtAFNHY7Ksf05TeDBhBUCEz_-Vm-0q6z0e00YDL891uTA5qwWDA4WNUa4s-uy6AkJ8Duru_qHD0TAr9m5ZYYqwo Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:23:23.579508 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/221481e35182443995ea17136383f6f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_221481e35182443995ea17136383f6f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/221481e35182443995ea17136383f6f4"}]}] Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: 221481e35182443995ea17136383f6f4 Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeTestJSON-950832246 Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: de0ef30352514ef9bb4559473e096ea6 Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeTestJSON-950832246-project Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.581950 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '14cea2ce-a906-4967-8453-71e73efd83b3'} Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:23:23.582876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. Jun 30 18:23:23.583983 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:23:23.584949 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] Returning 404 to user: Instance 14cea2ce-a906-4967-8453-71e73efd83b3 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:23:23.584949 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d0d4a072-d375-4d93-8f8b-e5ef5baac31a tempest-AttachVolumeTestJSON-950832246 tempest-AttachVolumeTestJSON-950832246-project] 10.222.0.16 "GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3" status: 404 len: 111 microversion: 2.1 time: 0.042729 Jun 30 18:23:23.584949 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 267/511] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:23:23 2022] GET /compute/v2.1/servers/14cea2ce-a906-4967-8453-71e73efd83b3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:23:45.762577 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:23:45.763210 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:23:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:24:13.010543 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:24:13.011250 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:24:13.013173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:24:13.013819 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:24:13.019509 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:24:13.019945 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:24:13.020710 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:24:13.021144 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:24:13.038118 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] HTTP exception thrown: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Request method failure captured: Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: DELETE /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 HTTP/1.1 Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL6FYylAQA5QUtIGY6-WeYVAJCtRDdyGdWxs5CjnPdannJc0DrRTjLsRDIxYwvU8oBpQLLugl0267HszgIUAgQ1uLB0677WnvU0KU4zCLRTz8p_PpddBX44P7RNaVsmiUu0Ehcgtd57WqIqL4h7WWj2Dm5HEkrtfidLTcAbgNyCWJY Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:24:13.039684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}] Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 2ed5e98a29c44296aeb921af4f521042 Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.042559 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '0d93f4ad-f4fd-4542-b0c1-d558283cc3e5'} Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:24:13.043984 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.046135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.048417 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Returning 404 to user: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:24:13.048417 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-799e691b-0f48-47b2-90f1-0a265548ca99 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 404 len: 111 microversion: 2.1 time: 0.034399 Jun 30 18:24:13.048417 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 245/512] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:24:13 2022] DELETE /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:24:13.054167 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:24:13.055338 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:24:13.061596 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:24:13.062775 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:24:13.071258 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:24:13.072046 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:24:13.073516 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:24:13.074441 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:24:13.103382 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] HTTP exception thrown: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Request method failure captured: Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 HTTP/1.1 Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveL6FYylAQA5QUtIGY6-WeYVAJCtRDdyGdWxs5CjnPdannJc0DrRTjLsRDIxYwvU8oBpQLLugl0267HszgIUAgQ1uLB0677WnvU0KU4zCLRTz8p_PpddBX44P7RNaVsmiUu0Ehcgtd57WqIqL4h7WWj2Dm5HEkrtfidLTcAbgNyCWJY Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:24:13.107007 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}] Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 2ed5e98a29c44296aeb921af4f521042 Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.108172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '0d93f4ad-f4fd-4542-b0c1-d558283cc3e5'} Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:24:13.108799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. Jun 30 18:24:13.109834 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:24:13.110909 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Returning 404 to user: Instance 0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:24:13.110909 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1639e673-0533-47ce-972f-fc00cac1863f tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5" status: 404 len: 111 microversion: 2.1 time: 0.062544 Jun 30 18:24:13.110909 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 268/513] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:24:13 2022] GET /compute/v2.1/servers/0d93f4ad-f4fd-4542-b0c1-d558283cc3e5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:24:37.058551 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:24:37.059104 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:24:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:24:39.207297 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:24:39.208142 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:24:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:25:11.687135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:25:11.689053 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:25:11.860802 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b16ae60e-1423-4e3a-8926-171a63d56503 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Action: 'create', calling method: .version_select at 0x7f8f3c29e550>, body: {"keypair": {"name": "tempest-TestShelveInstance-49126469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcBekn95sY682SYOmMVC6JuKYU3Qq9wIdcSBJ2tyjzZ6ggkmcgh8n9QpvNZrODXh6gymh/stnHNXLzndewRikOSFpzfJKV1h/G07Hor0GLQcFRFyHOfOxGUXtVlrdSoHQ=="}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:25:11.876002 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-b16ae60e-1423-4e3a-8926-171a63d56503 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Getting quotas for project a262c7be2bc040eea71787e95b11c92f. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:25:11.880241 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-b16ae60e-1423-4e3a-8926-171a63d56503 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Getting quotas for user 82765721711e484d8bc87340177657cc and project a262c7be2bc040eea71787e95b11c92f. Resources: {'key_pairs'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:25:11.911702 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b16ae60e-1423-4e3a-8926-171a63d56503 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.229471 Jun 30 18:25:11.912324 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 246/514] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 18:25:11 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:26:22.590968 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:26:22.591603 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:26:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:26:26.293431 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:26:26.293979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:26:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:26:28.682548 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:28.683286 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:28.688047 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1647881228", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "networks": [{"uuid": "44b04489-cab9-4d76-acb3-89236500da84"}]}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:26:28.912736 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.network.neutron [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] validate_networks() for [('44b04489-cab9-4d76-acb3-89236500da84', None, None, None, None, None)] {{(pid=129370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:26:29.307055 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Flavor limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:26:29.307466 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Image limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:26:29.307924 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Flavor pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:26:29.308347 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Image pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:26:29.308748 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:26:29.317471 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:29.317848 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:29.318666 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:29.319096 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:29.335462 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Getting quotas for project cbbed76024fb401d9519d28dabbf6457. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:26:29.339522 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Getting quotas for user 83e68d622a1c4e5892ea44b45257f133 and project cbbed76024fb401d9519d28dabbf6457. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:26:29.351302 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Going to run 1 instances... {{(pid=129370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:26:29.353518 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:26:29.402032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b9e236bc-6cf8-4b3b-b59d-0fedcf5b6c9b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720793 Jun 30 18:26:29.406469 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 269/515] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:26:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:26:29.411202 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 30 18:26:29.411717 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=4 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:29.412633 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:29.417470 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-9b64eb45-587a-4f13-a289-42680d28f218 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:29.417968 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-9b64eb45-587a-4f13-a289-42680d28f218 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:29.547220 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-9b64eb45-587a-4f13-a289-42680d28f218 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:29.554440 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-9b64eb45-587a-4f13-a289-42680d28f218 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1214 microversion: 2.1 time: 0.145695 Jun 30 18:26:29.554997 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 247/516] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:29 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:30.571308 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1737ca89-8e01-4f4d-8876-18b920c786b4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:30.571991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1737ca89-8e01-4f4d-8876-18b920c786b4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:30.579335 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1737ca89-8e01-4f4d-8876-18b920c786b4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:30.579780 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1737ca89-8e01-4f4d-8876-18b920c786b4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:30.580545 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1737ca89-8e01-4f4d-8876-18b920c786b4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:30.580977 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1737ca89-8e01-4f4d-8876-18b920c786b4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:30.651124 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1737ca89-8e01-4f4d-8876-18b920c786b4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:30.661696 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1737ca89-8e01-4f4d-8876-18b920c786b4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1210 microversion: 2.1 time: 0.094025 Jun 30 18:26:30.662502 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 270/517] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:30 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:31.684424 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ecbe263c-1a27-4c73-ac8c-95c3ca01591e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:31.685044 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ecbe263c-1a27-4c73-ac8c-95c3ca01591e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:31.696178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ecbe263c-1a27-4c73-ac8c-95c3ca01591e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:31.696810 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ecbe263c-1a27-4c73-ac8c-95c3ca01591e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:31.697655 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ecbe263c-1a27-4c73-ac8c-95c3ca01591e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:31.698087 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ecbe263c-1a27-4c73-ac8c-95c3ca01591e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:31.703988 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35240. Jun 30 18:26:31.768467 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ecbe263c-1a27-4c73-ac8c-95c3ca01591e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:31.777171 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ecbe263c-1a27-4c73-ac8c-95c3ca01591e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1210 microversion: 2.1 time: 0.096606 Jun 30 18:26:31.777810 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 248/518] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:31 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:32.794991 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5aa7dacc-e57a-487a-85a4-aba59c667093 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:32.795611 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5aa7dacc-e57a-487a-85a4-aba59c667093 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:32.802252 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5aa7dacc-e57a-487a-85a4-aba59c667093 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:32.802721 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5aa7dacc-e57a-487a-85a4-aba59c667093 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:32.803785 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5aa7dacc-e57a-487a-85a4-aba59c667093 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:32.804215 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5aa7dacc-e57a-487a-85a4-aba59c667093 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:32.872801 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-5aa7dacc-e57a-487a-85a4-aba59c667093 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:32.881438 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5aa7dacc-e57a-487a-85a4-aba59c667093 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1210 microversion: 2.1 time: 0.090426 Jun 30 18:26:32.882016 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 271/519] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:32 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:33.903863 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-12e2ded9-7d52-44b8-afbb-a0b0458cc12b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:33.905107 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-12e2ded9-7d52-44b8-afbb-a0b0458cc12b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:33.917391 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-7d52-44b8-afbb-a0b0458cc12b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:33.918232 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-7d52-44b8-afbb-a0b0458cc12b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:33.919705 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-7d52-44b8-afbb-a0b0458cc12b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:33.920488 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-7d52-44b8-afbb-a0b0458cc12b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:34.005909 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-12e2ded9-7d52-44b8-afbb-a0b0458cc12b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:34.014196 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-12e2ded9-7d52-44b8-afbb-a0b0458cc12b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1266 microversion: 2.1 time: 0.118682 Jun 30 18:26:34.014825 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 249/520] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:33 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:35.041905 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-01e0e710-9d9c-445e-b6e4-f61f17b16b5d tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:35.043055 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-01e0e710-9d9c-445e-b6e4-f61f17b16b5d tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:35.057311 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-01e0e710-9d9c-445e-b6e4-f61f17b16b5d tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:35.058119 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-01e0e710-9d9c-445e-b6e4-f61f17b16b5d tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:35.059523 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-01e0e710-9d9c-445e-b6e4-f61f17b16b5d tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:35.060538 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-01e0e710-9d9c-445e-b6e4-f61f17b16b5d tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:35.267952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-01e0e710-9d9c-445e-b6e4-f61f17b16b5d tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:35.277417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-01e0e710-9d9c-445e-b6e4-f61f17b16b5d tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.248445 Jun 30 18:26:35.288979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 272/521] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:35 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:35.624899 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-901292482", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-49126469", "security_groups": [{"name": "tempest-secgroup-smoke-862813305"}], "networks": [{"uuid": "18a3730e-a315-4149-9583-bdd00c771ec2"}], "block_device_mapping_v2": [{"uuid": "bf7f7be9-7568-46f3-9dd7-18e31a5815da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:26:35.792156 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] validate_networks() for [('18a3730e-a315-4149-9583-bdd00c771ec2', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:26:36.074860 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-44b428e3-0ae8-4948-a4e3-54e060b83e65 req-1c925afe-a0d5-4acf-b287-ffd39285846f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34218d6e-56af-4e10-9542-1c940fce06b4", "tag": "2d08e8c2-911a-473a-a302-4067569f606e"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:26:36.084092 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-44b428e3-0ae8-4948-a4e3-54e060b83e65 req-1c925afe-a0d5-4acf-b287-ffd39285846f service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:36.084708 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-44b428e3-0ae8-4948-a4e3-54e060b83e65 req-1c925afe-a0d5-4acf-b287-ffd39285846f service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:36.098523 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-44b428e3-0ae8-4948-a4e3-54e060b83e65 req-1c925afe-a0d5-4acf-b287-ffd39285846f service nova] Creating event network-changed:2d08e8c2-911a-473a-a302-4067569f606e for instance 34218d6e-56af-4e10-9542-1c940fce06b4 on hv-cinder-81268 Jun 30 18:26:36.103271 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR oslo.messaging._drivers.impl_rabbit [req-44b428e3-0ae8-4948-a4e3-54e060b83e65 req-1c925afe-a0d5-4acf-b287-ffd39285846f service nova] [eae7775c-2133-4b5e-a3e9-bc1633f396e2] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:26:36.480063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:26:36.480489 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:26:36.480960 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:26:36.481399 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:26:36.481803 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:26:36.493396 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:36.494172 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:36.495513 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:36.496046 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:36.521292 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Getting quotas for project a262c7be2bc040eea71787e95b11c92f. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:26:36.527601 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Getting quotas for user 82765721711e484d8bc87340177657cc and project a262c7be2bc040eea71787e95b11c92f. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:26:36.630009 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:26:36.632692 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf7f7be9-7568-46f3-9dd7-18e31a5815da',volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:26:36.789595 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-8297eda2-0186-4cb3-8486-60a4ce7bf1cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.172030 Jun 30 18:26:36.790721 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 250/522] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:26:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:26:36.795893 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-86ba9423-1c8a-4d16-864e-52a0a795cf82 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:36.796684 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-86ba9423-1c8a-4d16-864e-52a0a795cf82 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:36.804670 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86ba9423-1c8a-4d16-864e-52a0a795cf82 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:36.805120 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86ba9423-1c8a-4d16-864e-52a0a795cf82 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:36.805901 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86ba9423-1c8a-4d16-864e-52a0a795cf82 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:36.806352 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86ba9423-1c8a-4d16-864e-52a0a795cf82 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:37.022518 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-86ba9423-1c8a-4d16-864e-52a0a795cf82 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:37.031929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-86ba9423-1c8a-4d16-864e-52a0a795cf82 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.239848 Jun 30 18:26:37.032570 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 251/523] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:36 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:37.038969 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4dda9b63-52ca-4629-996e-f5da59da8a54 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:37.040001 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4dda9b63-52ca-4629-996e-f5da59da8a54 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:37.113864 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [req-44b428e3-0ae8-4948-a4e3-54e060b83e65 req-1c925afe-a0d5-4acf-b287-ffd39285846f service nova] [eae7775c-2133-4b5e-a3e9-bc1633f396e2] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35322. Jun 30 18:26:37.118681 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-44b428e3-0ae8-4948-a4e3-54e060b83e65 req-1c925afe-a0d5-4acf-b287-ffd39285846f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.119806 Jun 30 18:26:37.119539 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 273/524] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:26:37.125771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4dda9b63-52ca-4629-996e-f5da59da8a54 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:37.133044 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4dda9b63-52ca-4629-996e-f5da59da8a54 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1086 microversion: 2.1 time: 0.099080 Jun 30 18:26:37.134052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 252/525] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:37 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1086 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:38.060474 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9962c22a-b4ff-4641-9440-9b0c76b6017b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:38.061789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-9962c22a-b4ff-4641-9440-9b0c76b6017b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:38.073072 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9962c22a-b4ff-4641-9440-9b0c76b6017b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:38.073748 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9962c22a-b4ff-4641-9440-9b0c76b6017b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:38.074851 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9962c22a-b4ff-4641-9440-9b0c76b6017b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:38.075407 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9962c22a-b4ff-4641-9440-9b0c76b6017b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:38.155426 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-272ac998-9ec8-441b-bd60-05fbf8078aea tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:38.156573 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-272ac998-9ec8-441b-bd60-05fbf8078aea tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:38.169285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-272ac998-9ec8-441b-bd60-05fbf8078aea tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:38.170112 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-272ac998-9ec8-441b-bd60-05fbf8078aea tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:38.171631 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-272ac998-9ec8-441b-bd60-05fbf8078aea tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:38.172420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-272ac998-9ec8-441b-bd60-05fbf8078aea tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:38.258142 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-272ac998-9ec8-441b-bd60-05fbf8078aea tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:38.266003 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-9962c22a-b4ff-4641-9440-9b0c76b6017b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:38.266588 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-272ac998-9ec8-441b-bd60-05fbf8078aea tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1136 microversion: 2.1 time: 0.117569 Jun 30 18:26:38.267349 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 253/526] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:38 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1136 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:38.275111 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-9962c22a-b4ff-4641-9440-9b0c76b6017b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.222933 Jun 30 18:26:38.275694 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 274/527] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:38 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:39.284118 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-f1b20ac2-5563-4082-8bed-0c3b3ade7692 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:39.284676 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-f1b20ac2-5563-4082-8bed-0c3b3ade7692 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:39.291901 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f1b20ac2-5563-4082-8bed-0c3b3ade7692 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:39.292113 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ed60da02-91b9-4ddd-abb1-597e56babfcd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:39.292577 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f1b20ac2-5563-4082-8bed-0c3b3ade7692 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:39.292759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ed60da02-91b9-4ddd-abb1-597e56babfcd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:39.293169 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f1b20ac2-5563-4082-8bed-0c3b3ade7692 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:39.293662 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f1b20ac2-5563-4082-8bed-0c3b3ade7692 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:39.301506 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ed60da02-91b9-4ddd-abb1-597e56babfcd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:39.302389 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ed60da02-91b9-4ddd-abb1-597e56babfcd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:39.304126 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ed60da02-91b9-4ddd-abb1-597e56babfcd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:39.304908 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ed60da02-91b9-4ddd-abb1-597e56babfcd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:39.331988 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:39.345602 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=6 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:39.373019 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-f1b20ac2-5563-4082-8bed-0c3b3ade7692 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:39.387052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-f1b20ac2-5563-4082-8bed-0c3b3ade7692 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1136 microversion: 2.1 time: 0.106899 Jun 30 18:26:39.387999 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 254/528] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:39 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1136 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:39.478296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-ed60da02-91b9-4ddd-abb1-597e56babfcd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:39.486488 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ed60da02-91b9-4ddd-abb1-597e56babfcd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.198228 Jun 30 18:26:39.487093 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 275/529] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:39 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:40.405691 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-53508b49-2fa4-476c-a3dc-7ea0e1b4abc8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:40.406307 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-53508b49-2fa4-476c-a3dc-7ea0e1b4abc8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:40.414214 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-53508b49-2fa4-476c-a3dc-7ea0e1b4abc8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:40.414837 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-53508b49-2fa4-476c-a3dc-7ea0e1b4abc8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:40.415675 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-53508b49-2fa4-476c-a3dc-7ea0e1b4abc8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:40.416108 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-53508b49-2fa4-476c-a3dc-7ea0e1b4abc8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:40.482043 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-53508b49-2fa4-476c-a3dc-7ea0e1b4abc8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:40.489947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-53508b49-2fa4-476c-a3dc-7ea0e1b4abc8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1136 microversion: 2.1 time: 0.088473 Jun 30 18:26:40.490557 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 255/530] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:40 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1136 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:40.503338 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5808b183-e9ab-437d-a7ed-716c59042b30 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:40.504249 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5808b183-e9ab-437d-a7ed-716c59042b30 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:40.510260 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5808b183-e9ab-437d-a7ed-716c59042b30 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:40.510737 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5808b183-e9ab-437d-a7ed-716c59042b30 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:40.511505 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5808b183-e9ab-437d-a7ed-716c59042b30 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:40.511928 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5808b183-e9ab-437d-a7ed-716c59042b30 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:40.704352 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-5808b183-e9ab-437d-a7ed-716c59042b30 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:40.717248 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5808b183-e9ab-437d-a7ed-716c59042b30 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.217478 Jun 30 18:26:40.718042 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 276/531] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:40 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:41.507175 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ca40edeb-a076-43d4-af56-04093df08840 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:41.507997 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ca40edeb-a076-43d4-af56-04093df08840 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:41.514922 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca40edeb-a076-43d4-af56-04093df08840 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:41.515370 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca40edeb-a076-43d4-af56-04093df08840 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:41.516199 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca40edeb-a076-43d4-af56-04093df08840 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:41.516669 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca40edeb-a076-43d4-af56-04093df08840 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:41.581745 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ca40edeb-a076-43d4-af56-04093df08840 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:41.589736 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ca40edeb-a076-43d4-af56-04093df08840 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1136 microversion: 2.1 time: 0.086618 Jun 30 18:26:41.590712 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 256/532] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:41 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:41.740388 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6f92fd42-df82-4e1d-be9b-47cec947af47 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:41.741071 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6f92fd42-df82-4e1d-be9b-47cec947af47 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:41.747651 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6f92fd42-df82-4e1d-be9b-47cec947af47 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:41.748140 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6f92fd42-df82-4e1d-be9b-47cec947af47 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:41.748998 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6f92fd42-df82-4e1d-be9b-47cec947af47 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:41.749475 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6f92fd42-df82-4e1d-be9b-47cec947af47 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:41.894697 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6f92fd42-df82-4e1d-be9b-47cec947af47 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:41.904313 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6f92fd42-df82-4e1d-be9b-47cec947af47 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.168664 Jun 30 18:26:41.905116 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 277/533] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:41 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:42.607905 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-60bcf7cb-2389-4553-a4d9-6ea3bbee60d3 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:42.608570 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-60bcf7cb-2389-4553-a4d9-6ea3bbee60d3 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:42.615985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-60bcf7cb-2389-4553-a4d9-6ea3bbee60d3 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:42.616326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-60bcf7cb-2389-4553-a4d9-6ea3bbee60d3 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:42.617100 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-60bcf7cb-2389-4553-a4d9-6ea3bbee60d3 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:42.617626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-60bcf7cb-2389-4553-a4d9-6ea3bbee60d3 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:42.698267 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-60bcf7cb-2389-4553-a4d9-6ea3bbee60d3 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:42.710418 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-60bcf7cb-2389-4553-a4d9-6ea3bbee60d3 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1136 microversion: 2.1 time: 0.106257 Jun 30 18:26:42.711465 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 257/534] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:42 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1136 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:42.931911 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2e5885f7-f733-43f8-ae45-1b98a39c062c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:42.932719 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-2e5885f7-f733-43f8-ae45-1b98a39c062c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:42.945475 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2e5885f7-f733-43f8-ae45-1b98a39c062c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:42.946298 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2e5885f7-f733-43f8-ae45-1b98a39c062c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:42.947799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2e5885f7-f733-43f8-ae45-1b98a39c062c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:42.948573 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2e5885f7-f733-43f8-ae45-1b98a39c062c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:43.134572 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2e5885f7-f733-43f8-ae45-1b98a39c062c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:43.146772 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2e5885f7-f733-43f8-ae45-1b98a39c062c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.219811 Jun 30 18:26:43.147838 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 278/535] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:42 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:43.739112 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6aab0a72-4ae2-49ce-b48a-8f8cf281bf46 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:43.739765 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6aab0a72-4ae2-49ce-b48a-8f8cf281bf46 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:43.751739 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6aab0a72-4ae2-49ce-b48a-8f8cf281bf46 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:43.753578 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6aab0a72-4ae2-49ce-b48a-8f8cf281bf46 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:43.754986 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6aab0a72-4ae2-49ce-b48a-8f8cf281bf46 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:43.755823 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6aab0a72-4ae2-49ce-b48a-8f8cf281bf46 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:44.088549 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6aab0a72-4ae2-49ce-b48a-8f8cf281bf46 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:44.096120 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6aab0a72-4ae2-49ce-b48a-8f8cf281bf46 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1128 microversion: 2.1 time: 0.364540 Jun 30 18:26:44.096702 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 258/536] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:43 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1128 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:44.167397 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-fbfbbc13-f149-4426-9dc3-56d07d8b86de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:44.168604 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-fbfbbc13-f149-4426-9dc3-56d07d8b86de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:44.178263 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fbfbbc13-f149-4426-9dc3-56d07d8b86de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:44.178760 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fbfbbc13-f149-4426-9dc3-56d07d8b86de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:44.179821 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fbfbbc13-f149-4426-9dc3-56d07d8b86de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:44.180465 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fbfbbc13-f149-4426-9dc3-56d07d8b86de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:44.459664 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-fbfbbc13-f149-4426-9dc3-56d07d8b86de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:44.472015 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-fbfbbc13-f149-4426-9dc3-56d07d8b86de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.310424 Jun 30 18:26:44.472700 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 279/537] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:44 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:45.114276 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1a8acfac-45ae-4619-8f8c-f0e359609082 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:45.115059 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1a8acfac-45ae-4619-8f8c-f0e359609082 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:45.123528 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1a8acfac-45ae-4619-8f8c-f0e359609082 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:45.123998 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1a8acfac-45ae-4619-8f8c-f0e359609082 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:45.124760 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1a8acfac-45ae-4619-8f8c-f0e359609082 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:45.125167 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1a8acfac-45ae-4619-8f8c-f0e359609082 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:45.379746 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1a8acfac-45ae-4619-8f8c-f0e359609082 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:45.389771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1a8acfac-45ae-4619-8f8c-f0e359609082 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1269 microversion: 2.1 time: 0.279667 Jun 30 18:26:45.402637 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 259/538] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:45 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1269 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:45.493609 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-73712b18-62aa-4183-83e0-d0a8ed0b936b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:45.494297 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-73712b18-62aa-4183-83e0-d0a8ed0b936b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:45.503114 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-73712b18-62aa-4183-83e0-d0a8ed0b936b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:45.503511 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-73712b18-62aa-4183-83e0-d0a8ed0b936b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:45.504302 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-73712b18-62aa-4183-83e0-d0a8ed0b936b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:45.504731 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-73712b18-62aa-4183-83e0-d0a8ed0b936b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:45.711057 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-73712b18-62aa-4183-83e0-d0a8ed0b936b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:45.718836 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-73712b18-62aa-4183-83e0-d0a8ed0b936b tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.229242 Jun 30 18:26:45.719421 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 280/539] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:45 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:46.287987 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-21faf8fb-24bd-4852-8827-4494ecc1aa90 req-4d0c15f6-f55e-4ae4-a9f3-580aca02c16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513aedba-0675-4c23-a0dc-c081a54704d9", "tag": "3d9c8a6c-255b-46d9-828b-11136e25b879"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:26:46.297080 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-21faf8fb-24bd-4852-8827-4494ecc1aa90 req-4d0c15f6-f55e-4ae4-a9f3-580aca02c16d service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:46.297838 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-21faf8fb-24bd-4852-8827-4494ecc1aa90 req-4d0c15f6-f55e-4ae4-a9f3-580aca02c16d service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:46.312022 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-21faf8fb-24bd-4852-8827-4494ecc1aa90 req-4d0c15f6-f55e-4ae4-a9f3-580aca02c16d service nova] Creating event network-changed:3d9c8a6c-255b-46d9-828b-11136e25b879 for instance 513aedba-0675-4c23-a0dc-c081a54704d9 on hv-cinder-81268 Jun 30 18:26:46.315936 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [req-21faf8fb-24bd-4852-8827-4494ecc1aa90 req-4d0c15f6-f55e-4ae4-a9f3-580aca02c16d service nova] [25ea317b-187f-423d-a352-e28696903890] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:26:46.409876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-44debea1-fd46-4f59-8dfc-ec8ce14b3312 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:46.410892 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-44debea1-fd46-4f59-8dfc-ec8ce14b3312 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:46.416969 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-44debea1-fd46-4f59-8dfc-ec8ce14b3312 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:46.417524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-44debea1-fd46-4f59-8dfc-ec8ce14b3312 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:46.418300 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-44debea1-fd46-4f59-8dfc-ec8ce14b3312 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:46.418753 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-44debea1-fd46-4f59-8dfc-ec8ce14b3312 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:46.504539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:46.575633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-44debea1-fd46-4f59-8dfc-ec8ce14b3312 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:46.584360 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-44debea1-fd46-4f59-8dfc-ec8ce14b3312 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.179039 Jun 30 18:26:46.585015 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 281/540] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:46 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:46.738238 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2bf667d0-ee86-4fa7-9854-ff9e0ac6a57f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:46.738965 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-2bf667d0-ee86-4fa7-9854-ff9e0ac6a57f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:46.746914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2bf667d0-ee86-4fa7-9854-ff9e0ac6a57f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:46.747550 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2bf667d0-ee86-4fa7-9854-ff9e0ac6a57f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:46.748360 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2bf667d0-ee86-4fa7-9854-ff9e0ac6a57f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:46.749032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2bf667d0-ee86-4fa7-9854-ff9e0ac6a57f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:46.915238 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2bf667d0-ee86-4fa7-9854-ff9e0ac6a57f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:46.925578 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2bf667d0-ee86-4fa7-9854-ff9e0ac6a57f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.191989 Jun 30 18:26:46.926691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 282/541] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:46 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:47.130225 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=10 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:47.140256 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-05f4b2fe-ac9c-4412-9f71-abfe17f49396 req-54edc07c-ffdb-4f84-81d0-2ba7fd1059c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34218d6e-56af-4e10-9542-1c940fce06b4", "name": "network-vif-plugged", "status": "completed", "tag": "2d08e8c2-911a-473a-a302-4067569f606e"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:26:47.149301 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-05f4b2fe-ac9c-4412-9f71-abfe17f49396 req-54edc07c-ffdb-4f84-81d0-2ba7fd1059c8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:47.149733 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-05f4b2fe-ac9c-4412-9f71-abfe17f49396 req-54edc07c-ffdb-4f84-81d0-2ba7fd1059c8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:47.162848 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-05f4b2fe-ac9c-4412-9f71-abfe17f49396 req-54edc07c-ffdb-4f84-81d0-2ba7fd1059c8 service nova] Creating event network-vif-plugged:2d08e8c2-911a-473a-a302-4067569f606e for instance 34218d6e-56af-4e10-9542-1c940fce06b4 on hv-cinder-81268 Jun 30 18:26:47.168456 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-05f4b2fe-ac9c-4412-9f71-abfe17f49396 req-54edc07c-ffdb-4f84-81d0-2ba7fd1059c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204140 Jun 30 18:26:47.169381 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 283/542] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:26:47.326317 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [req-21faf8fb-24bd-4852-8827-4494ecc1aa90 req-4d0c15f6-f55e-4ae4-a9f3-580aca02c16d service nova] [25ea317b-187f-423d-a352-e28696903890] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35454. Jun 30 18:26:47.331658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-21faf8fb-24bd-4852-8827-4494ecc1aa90 req-4d0c15f6-f55e-4ae4-a9f3-580aca02c16d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.144925 Jun 30 18:26:47.332701 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 260/543] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:26:47.602396 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-91a3bbbc-9efa-4353-9a20-b7cb48bd22ff tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:47.603317 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-91a3bbbc-9efa-4353-9a20-b7cb48bd22ff tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:47.610607 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-91a3bbbc-9efa-4353-9a20-b7cb48bd22ff tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:47.611133 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-91a3bbbc-9efa-4353-9a20-b7cb48bd22ff tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:47.612027 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-91a3bbbc-9efa-4353-9a20-b7cb48bd22ff tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:47.612455 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-91a3bbbc-9efa-4353-9a20-b7cb48bd22ff tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:47.796531 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-91a3bbbc-9efa-4353-9a20-b7cb48bd22ff tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:47.810060 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-91a3bbbc-9efa-4353-9a20-b7cb48bd22ff tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.212324 Jun 30 18:26:47.811377 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 284/544] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:47 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:47.948638 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3af8f5c2-73fd-4653-9ef9-208847582f38 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:47.949812 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3af8f5c2-73fd-4653-9ef9-208847582f38 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:47.960743 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3af8f5c2-73fd-4653-9ef9-208847582f38 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:47.961822 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3af8f5c2-73fd-4653-9ef9-208847582f38 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:47.962862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3af8f5c2-73fd-4653-9ef9-208847582f38 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:47.963412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3af8f5c2-73fd-4653-9ef9-208847582f38 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:48.214606 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3af8f5c2-73fd-4653-9ef9-208847582f38 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:48.224697 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3af8f5c2-73fd-4653-9ef9-208847582f38 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.285331 Jun 30 18:26:48.225704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 261/545] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:47 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:48.832536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-43a3d2c3-586a-4867-a8a5-940fc4492852 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:48.833403 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-43a3d2c3-586a-4867-a8a5-940fc4492852 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:48.842317 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-43a3d2c3-586a-4867-a8a5-940fc4492852 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:48.842814 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-43a3d2c3-586a-4867-a8a5-940fc4492852 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:48.843625 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-43a3d2c3-586a-4867-a8a5-940fc4492852 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:48.844087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-43a3d2c3-586a-4867-a8a5-940fc4492852 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:49.015088 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-43a3d2c3-586a-4867-a8a5-940fc4492852 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:49.023184 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-43a3d2c3-586a-4867-a8a5-940fc4492852 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.197552 Jun 30 18:26:49.023761 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 285/546] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:48 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:49.243600 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-51648a32-3fd3-4120-ae61-2b0f0721c164 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:49.244200 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-51648a32-3fd3-4120-ae61-2b0f0721c164 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:49.250757 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-51648a32-3fd3-4120-ae61-2b0f0721c164 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:49.251201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-51648a32-3fd3-4120-ae61-2b0f0721c164 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:49.251966 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-51648a32-3fd3-4120-ae61-2b0f0721c164 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:49.252395 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-51648a32-3fd3-4120-ae61-2b0f0721c164 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:49.448563 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-51648a32-3fd3-4120-ae61-2b0f0721c164 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:49.457433 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-51648a32-3fd3-4120-ae61-2b0f0721c164 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1314 microversion: 2.1 time: 0.218917 Jun 30 18:26:49.458098 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 262/547] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:49 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:50.042780 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-80348d66-00cb-4300-a394-baef378a45b5 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:50.043653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-80348d66-00cb-4300-a394-baef378a45b5 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:50.050600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-80348d66-00cb-4300-a394-baef378a45b5 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:50.051042 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-80348d66-00cb-4300-a394-baef378a45b5 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:50.052111 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-80348d66-00cb-4300-a394-baef378a45b5 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:50.052893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-80348d66-00cb-4300-a394-baef378a45b5 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:50.209865 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-80348d66-00cb-4300-a394-baef378a45b5 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:50.218757 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-80348d66-00cb-4300-a394-baef378a45b5 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.180461 Jun 30 18:26:50.219621 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 286/548] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:50 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:50.482756 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1bbc98ab-c2e5-4279-9339-79c5653b5687 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:50.483278 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1bbc98ab-c2e5-4279-9339-79c5653b5687 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:50.491537 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1bbc98ab-c2e5-4279-9339-79c5653b5687 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:50.491991 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1bbc98ab-c2e5-4279-9339-79c5653b5687 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:50.492767 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1bbc98ab-c2e5-4279-9339-79c5653b5687 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:50.493382 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1bbc98ab-c2e5-4279-9339-79c5653b5687 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:50.660011 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1bbc98ab-c2e5-4279-9339-79c5653b5687 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:50.670847 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1bbc98ab-c2e5-4279-9339-79c5653b5687 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1498 microversion: 2.1 time: 0.191916 Jun 30 18:26:50.671420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 263/549] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:50 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1498 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:51.208971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-782ba518-eafb-4af4-8261-29bf92431890 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:51.209648 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-782ba518-eafb-4af4-8261-29bf92431890 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:51.216082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-782ba518-eafb-4af4-8261-29bf92431890 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:51.216520 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-782ba518-eafb-4af4-8261-29bf92431890 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:51.217292 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-782ba518-eafb-4af4-8261-29bf92431890 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:51.217721 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-782ba518-eafb-4af4-8261-29bf92431890 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:51.238532 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=100 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:51.240838 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7612f829-b156-46fd-9055-ce4303789fc1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:51.241942 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7612f829-b156-46fd-9055-ce4303789fc1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:51.246743 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-782ba518-eafb-4af4-8261-29bf92431890 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Going to try to terminate instance {{(pid=129370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:26:51.255412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7612f829-b156-46fd-9055-ce4303789fc1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:51.255412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7612f829-b156-46fd-9055-ce4303789fc1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:51.255743 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7612f829-b156-46fd-9055-ce4303789fc1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:51.256171 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7612f829-b156-46fd-9055-ce4303789fc1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:51.345152 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-782ba518-eafb-4af4-8261-29bf92431890 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 204 len: 0 microversion: 2.1 time: 0.140343 Jun 30 18:26:51.345766 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 287/550] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:26:51 2022] DELETE /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:26:51.354947 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-51170d62-39e1-4a09-a4f7-4c21b1d8b0d4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:51.355524 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-51170d62-39e1-4a09-a4f7-4c21b1d8b0d4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:51.362839 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-51170d62-39e1-4a09-a4f7-4c21b1d8b0d4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:51.363629 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-51170d62-39e1-4a09-a4f7-4c21b1d8b0d4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:51.364576 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-51170d62-39e1-4a09-a4f7-4c21b1d8b0d4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:51.365016 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-51170d62-39e1-4a09-a4f7-4c21b1d8b0d4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:51.430368 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7612f829-b156-46fd-9055-ce4303789fc1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:51.442752 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7612f829-b156-46fd-9055-ce4303789fc1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.208769 Jun 30 18:26:51.444021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 264/551] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:51 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:51.566040 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-51170d62-39e1-4a09-a4f7-4c21b1d8b0d4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:51.574026 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-51170d62-39e1-4a09-a4f7-4c21b1d8b0d4 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1504 microversion: 2.1 time: 0.223501 Jun 30 18:26:51.574632 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 288/552] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:51 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:52.462875 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0dae1ddc-a786-42a0-805d-645568bfed3b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:52.463525 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0dae1ddc-a786-42a0-805d-645568bfed3b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:52.470293 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0dae1ddc-a786-42a0-805d-645568bfed3b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:52.470774 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0dae1ddc-a786-42a0-805d-645568bfed3b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:52.472111 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0dae1ddc-a786-42a0-805d-645568bfed3b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:52.472549 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0dae1ddc-a786-42a0-805d-645568bfed3b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:52.593226 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-9e9504f0-4ca3-4912-a5bb-fc38bb21d60e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:52.593836 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-9e9504f0-4ca3-4912-a5bb-fc38bb21d60e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:52.603778 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9e9504f0-4ca3-4912-a5bb-fc38bb21d60e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:52.604749 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9e9504f0-4ca3-4912-a5bb-fc38bb21d60e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:52.606064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9e9504f0-4ca3-4912-a5bb-fc38bb21d60e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:52.606567 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-9e9504f0-4ca3-4912-a5bb-fc38bb21d60e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:52.621900 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0dae1ddc-a786-42a0-805d-645568bfed3b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:52.633488 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0dae1ddc-a786-42a0-805d-645568bfed3b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.174246 Jun 30 18:26:52.634205 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 265/553] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:52 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:52.785281 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-9e9504f0-4ca3-4912-a5bb-fc38bb21d60e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:52.798783 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-9e9504f0-4ca3-4912-a5bb-fc38bb21d60e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1504 microversion: 2.1 time: 0.209769 Jun 30 18:26:52.800022 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 289/554] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:52 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:53.651511 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-8072e9e4-8fdc-4321-a120-d2788d959d59 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:53.652118 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8072e9e4-8fdc-4321-a120-d2788d959d59 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:53.660885 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8072e9e4-8fdc-4321-a120-d2788d959d59 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:53.661394 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8072e9e4-8fdc-4321-a120-d2788d959d59 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:53.662482 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8072e9e4-8fdc-4321-a120-d2788d959d59 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:53.662864 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8072e9e4-8fdc-4321-a120-d2788d959d59 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:53.821971 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-8072e9e4-8fdc-4321-a120-d2788d959d59 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:53.825518 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=100 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:53.829217 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5e07d07c-e255-4607-9ca6-42750f88829a tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:53.830913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5e07d07c-e255-4607-9ca6-42750f88829a tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:53.831734 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-8072e9e4-8fdc-4321-a120-d2788d959d59 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.184063 Jun 30 18:26:53.832319 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 266/555] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:53 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:53.838806 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5e07d07c-e255-4607-9ca6-42750f88829a tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:53.839303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5e07d07c-e255-4607-9ca6-42750f88829a tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:53.840137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5e07d07c-e255-4607-9ca6-42750f88829a tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:53.840587 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5e07d07c-e255-4607-9ca6-42750f88829a tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:53.996822 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-5e07d07c-e255-4607-9ca6-42750f88829a tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:54.006725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5e07d07c-e255-4607-9ca6-42750f88829a tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1504 microversion: 2.1 time: 0.187689 Jun 30 18:26:54.007361 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 290/556] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:53 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:54.850344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-caa270e0-9b49-4131-ab96-6e6cbf51b4f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:54.851002 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-caa270e0-9b49-4131-ab96-6e6cbf51b4f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:54.857603 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-caa270e0-9b49-4131-ab96-6e6cbf51b4f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:54.858039 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-caa270e0-9b49-4131-ab96-6e6cbf51b4f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:54.858868 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-caa270e0-9b49-4131-ab96-6e6cbf51b4f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:54.859290 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-caa270e0-9b49-4131-ab96-6e6cbf51b4f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:55.026215 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5fa0d4c4-7a3f-41ec-b17f-f68215ed04b7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:55.026895 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5fa0d4c4-7a3f-41ec-b17f-f68215ed04b7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:55.033181 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5fa0d4c4-7a3f-41ec-b17f-f68215ed04b7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:55.033653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5fa0d4c4-7a3f-41ec-b17f-f68215ed04b7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:55.034482 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5fa0d4c4-7a3f-41ec-b17f-f68215ed04b7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:55.034907 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5fa0d4c4-7a3f-41ec-b17f-f68215ed04b7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:55.105050 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-caa270e0-9b49-4131-ab96-6e6cbf51b4f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:55.113225 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-caa270e0-9b49-4131-ab96-6e6cbf51b4f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.267536 Jun 30 18:26:55.113859 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 267/557] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:54 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:55.217122 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-5fa0d4c4-7a3f-41ec-b17f-f68215ed04b7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:55.226513 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5fa0d4c4-7a3f-41ec-b17f-f68215ed04b7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 200 len: 1504 microversion: 2.1 time: 0.204226 Jun 30 18:26:55.227691 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 291/558] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:55 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:55.448475 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-94e91b7e-be75-4e62-a829-a8dfcfce8a48 req-e711f44d-0bb0-4b16-9982-6df7be9398aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34218d6e-56af-4e10-9542-1c940fce06b4", "name": "network-vif-deleted", "tag": "2d08e8c2-911a-473a-a302-4067569f606e"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:26:55.459942 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-94e91b7e-be75-4e62-a829-a8dfcfce8a48 req-e711f44d-0bb0-4b16-9982-6df7be9398aa service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:55.460551 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-94e91b7e-be75-4e62-a829-a8dfcfce8a48 req-e711f44d-0bb0-4b16-9982-6df7be9398aa service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:55.473953 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-94e91b7e-be75-4e62-a829-a8dfcfce8a48 req-e711f44d-0bb0-4b16-9982-6df7be9398aa service nova] Creating event network-vif-deleted:2d08e8c2-911a-473a-a302-4067569f606e for instance 34218d6e-56af-4e10-9542-1c940fce06b4 on hv-cinder-81268 Jun 30 18:26:55.482818 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-94e91b7e-be75-4e62-a829-a8dfcfce8a48 req-e711f44d-0bb0-4b16-9982-6df7be9398aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038643 Jun 30 18:26:55.483452 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 268/559] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:26:56.134238 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-83e8ab9a-9c89-4032-9b64-52eb22c83c17 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:56.135208 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-83e8ab9a-9c89-4032-9b64-52eb22c83c17 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:56.142458 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-83e8ab9a-9c89-4032-9b64-52eb22c83c17 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:56.143082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-83e8ab9a-9c89-4032-9b64-52eb22c83c17 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:56.143938 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-83e8ab9a-9c89-4032-9b64-52eb22c83c17 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:56.144457 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-83e8ab9a-9c89-4032-9b64-52eb22c83c17 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:56.250024 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:56.250738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 34218d6e-56af-4e10-9542-1c940fce06b4] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:56.261045 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:56.261748 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:56.263118 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:56.263299 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:56.280062 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] HTTP exception thrown: Instance 34218d6e-56af-4e10-9542-1c940fce06b4 could not be found. Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Request method failure captured: Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 HTTP/1.1 Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiverP_lpotvu7FRU2CAvxI8ok8uvkXX0Xy22R6phwglrnxhUruGLqvUrdYv98p-duOnncTjF6hSM4reMybN2abMrDs_XvPIT0Mwge0oNvq0UKUxNqyDgtZmlBPMyBM19Jcsn5oML072NfMdeBHAIpJAS8uctXUcYdJCtBsfjfcJql7P4 Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: cbbed76024fb401d9519d28dabbf6457 Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-VolumesActionsTest-1558912358 Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:26:56.281804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cbbed76024fb401d9519d28dabbf6457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cbbed76024fb401d9519d28dabbf6457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cbbed76024fb401d9519d28dabbf6457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cbbed76024fb401d9519d28dabbf6457"}]}] Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-VolumesActionsTest-1558912358 Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: cbbed76024fb401d9519d28dabbf6457 Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-VolumesActionsTest-1558912358 Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-VolumesActionsTest-1558912358-project Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 83e68d622a1c4e5892ea44b45257f133 Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-VolumesActionsTest-1558912358-project Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 34218d6e-56af-4e10-9542-1c940fce06b4 could not be found. Jun 30 18:26:56.283381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '34218d6e-56af-4e10-9542-1c940fce06b4'} Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34218d6e-56af-4e10-9542-1c940fce06b4 could not be found. Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:26:56.284188 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34218d6e-56af-4e10-9542-1c940fce06b4 could not be found. Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34218d6e-56af-4e10-9542-1c940fce06b4 could not be found. Jun 30 18:26:56.285612 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:26:56.287678 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Returning 404 to user: Instance 34218d6e-56af-4e10-9542-1c940fce06b4 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:26:56.288680 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-df80eff1-feea-4ec2-8721-7e514641c96e tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4" status: 404 len: 111 microversion: 2.1 time: 0.043780 Jun 30 18:26:56.289400 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 269/560] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:56 2022] GET /compute/v2.1/servers/34218d6e-56af-4e10-9542-1c940fce06b4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 18:26:56.325048 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-83e8ab9a-9c89-4032-9b64-52eb22c83c17 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:56.340078 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-83e8ab9a-9c89-4032-9b64-52eb22c83c17 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.209655 Jun 30 18:26:56.347212 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 292/561] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:56 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:56.417145 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-126219917", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452", "networks": [{"uuid": "44b04489-cab9-4d76-acb3-89236500da84"}]}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:26:56.475844 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] validate_networks() for [('44b04489-cab9-4d76-acb3-89236500da84', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:26:56.982027 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:26:56.982481 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:26:56.983067 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:26:56.983351 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:26:56.983802 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:26:56.995730 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:56.996183 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:56.996976 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:56.997412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:57.016065 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Getting quotas for project cbbed76024fb401d9519d28dabbf6457. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:26:57.021072 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Getting quotas for user 83e68d622a1c4e5892ea44b45257f133 and project cbbed76024fb401d9519d28dabbf6457. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:26:57.032676 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:26:57.035546 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:26:57.083103 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-97e36d51-2f34-43eb-a48a-bdbfe2317060 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671190 Jun 30 18:26:57.083737 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 270/562] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:26:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:26:57.093673 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-41f2a955-b796-4699-93a1-84c8e0e49159 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:57.094278 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-41f2a955-b796-4699-93a1-84c8e0e49159 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:57.164850 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-41f2a955-b796-4699-93a1-84c8e0e49159 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:57.171859 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-41f2a955-b796-4699-93a1-84c8e0e49159 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1213 microversion: 2.1 time: 0.082071 Jun 30 18:26:57.172551 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 293/563] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:57 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:57.362561 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-55fad5cb-17aa-4e3d-8479-4fa6351849e8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:57.363232 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-55fad5cb-17aa-4e3d-8479-4fa6351849e8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:57.371118 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-55fad5cb-17aa-4e3d-8479-4fa6351849e8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:57.371563 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-55fad5cb-17aa-4e3d-8479-4fa6351849e8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:57.372861 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-55fad5cb-17aa-4e3d-8479-4fa6351849e8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:57.373339 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-55fad5cb-17aa-4e3d-8479-4fa6351849e8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:57.548344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-55fad5cb-17aa-4e3d-8479-4fa6351849e8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:57.559141 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-55fad5cb-17aa-4e3d-8479-4fa6351849e8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.203738 Jun 30 18:26:57.570298 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 271/564] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:57 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:58.189639 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-53bfaba5-8ef7-4211-a84c-c63dd44fa0b1 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:58.190291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-53bfaba5-8ef7-4211-a84c-c63dd44fa0b1 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:58.196660 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-53bfaba5-8ef7-4211-a84c-c63dd44fa0b1 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:58.197087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-53bfaba5-8ef7-4211-a84c-c63dd44fa0b1 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:58.198110 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-53bfaba5-8ef7-4211-a84c-c63dd44fa0b1 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:58.198639 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-53bfaba5-8ef7-4211-a84c-c63dd44fa0b1 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:58.284414 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-53bfaba5-8ef7-4211-a84c-c63dd44fa0b1 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:58.299405 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-53bfaba5-8ef7-4211-a84c-c63dd44fa0b1 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1273 microversion: 2.1 time: 0.112137 Jun 30 18:26:58.300032 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 294/565] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:58 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:58.577912 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6fd201ce-6a6d-434d-bed2-c0c9f4fa42a8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:58.578715 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6fd201ce-6a6d-434d-bed2-c0c9f4fa42a8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:58.588606 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6fd201ce-6a6d-434d-bed2-c0c9f4fa42a8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:58.589167 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6fd201ce-6a6d-434d-bed2-c0c9f4fa42a8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:58.590070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6fd201ce-6a6d-434d-bed2-c0c9f4fa42a8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:58.590771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6fd201ce-6a6d-434d-bed2-c0c9f4fa42a8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:58.896512 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6fd201ce-6a6d-434d-bed2-c0c9f4fa42a8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:58.916459 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-e707e7c0-338d-4235-b61a-dea25af9106a req-5c2d347d-f8d7-4eeb-b5fa-e57825356b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513aedba-0675-4c23-a0dc-c081a54704d9", "name": "network-vif-plugged", "status": "completed", "tag": "3d9c8a6c-255b-46d9-828b-11136e25b879"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:26:58.916809 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6fd201ce-6a6d-434d-bed2-c0c9f4fa42a8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.341850 Jun 30 18:26:58.917357 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 272/566] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:58 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:26:58.940031 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:26:58.949675 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-e707e7c0-338d-4235-b61a-dea25af9106a req-5c2d347d-f8d7-4eeb-b5fa-e57825356b33 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:58.950140 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-e707e7c0-338d-4235-b61a-dea25af9106a req-5c2d347d-f8d7-4eeb-b5fa-e57825356b33 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:58.980058 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-e707e7c0-338d-4235-b61a-dea25af9106a req-5c2d347d-f8d7-4eeb-b5fa-e57825356b33 service nova] Creating event network-vif-plugged:3d9c8a6c-255b-46d9-828b-11136e25b879 for instance 513aedba-0675-4c23-a0dc-c081a54704d9 on hv-cinder-81268 Jun 30 18:26:59.005298 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-e707e7c0-338d-4235-b61a-dea25af9106a req-5c2d347d-f8d7-4eeb-b5fa-e57825356b33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094487 Jun 30 18:26:59.007066 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 295/567] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:26:59.318043 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-fc4df0ba-734c-4fc8-9510-e0cb16d78e62 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:59.319117 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-fc4df0ba-734c-4fc8-9510-e0cb16d78e62 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:59.326425 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fc4df0ba-734c-4fc8-9510-e0cb16d78e62 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:59.327240 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fc4df0ba-734c-4fc8-9510-e0cb16d78e62 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:59.328305 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fc4df0ba-734c-4fc8-9510-e0cb16d78e62 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:59.329483 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-fc4df0ba-734c-4fc8-9510-e0cb16d78e62 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:59.545055 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-fc4df0ba-734c-4fc8-9510-e0cb16d78e62 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:26:59.554939 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-fc4df0ba-734c-4fc8-9510-e0cb16d78e62 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1313 microversion: 2.1 time: 0.242004 Jun 30 18:26:59.555819 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 273/568] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:59 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:26:59.935587 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-01259f34-eafc-40ef-a9c6-360d2f47f2e1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:26:59.936487 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-01259f34-eafc-40ef-a9c6-360d2f47f2e1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:26:59.944367 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-01259f34-eafc-40ef-a9c6-360d2f47f2e1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:59.945267 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-01259f34-eafc-40ef-a9c6-360d2f47f2e1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:26:59.946261 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-01259f34-eafc-40ef-a9c6-360d2f47f2e1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:26:59.946866 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-01259f34-eafc-40ef-a9c6-360d2f47f2e1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:00.121557 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-01259f34-eafc-40ef-a9c6-360d2f47f2e1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:00.133148 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-01259f34-eafc-40ef-a9c6-360d2f47f2e1 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1257 microversion: 2.1 time: 0.202688 Jun 30 18:27:00.133742 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 296/569] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:26:59 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1257 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:00.361339 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-e6dff18a-8fe5-4222-a552-f2085f2546d6 req-916e08cf-d798-4c13-80d0-256d24d8148e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345eb489-de32-4d6b-bbc6-1f342fe2bfca", "tag": "3384ebab-fbe3-4baa-af32-1d7ba69cf91b"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:27:00.366535 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:00.374558 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-e6dff18a-8fe5-4222-a552-f2085f2546d6 req-916e08cf-d798-4c13-80d0-256d24d8148e service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:00.375230 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-e6dff18a-8fe5-4222-a552-f2085f2546d6 req-916e08cf-d798-4c13-80d0-256d24d8148e service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:00.396895 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-e6dff18a-8fe5-4222-a552-f2085f2546d6 req-916e08cf-d798-4c13-80d0-256d24d8148e service nova] Creating event network-changed:3384ebab-fbe3-4baa-af32-1d7ba69cf91b for instance 345eb489-de32-4d6b-bbc6-1f342fe2bfca on hv-cinder-81268 Jun 30 18:27:00.402561 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-e6dff18a-8fe5-4222-a552-f2085f2546d6 req-916e08cf-d798-4c13-80d0-256d24d8148e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044552 Jun 30 18:27:00.406522 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 274/570] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:27:00.573327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4eddd75f-8806-4b0d-b4fd-32be8c54200c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:00.574017 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4eddd75f-8806-4b0d-b4fd-32be8c54200c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:00.581202 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4eddd75f-8806-4b0d-b4fd-32be8c54200c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:00.581785 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4eddd75f-8806-4b0d-b4fd-32be8c54200c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:00.583249 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4eddd75f-8806-4b0d-b4fd-32be8c54200c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:00.583928 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4eddd75f-8806-4b0d-b4fd-32be8c54200c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:00.723647 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4eddd75f-8806-4b0d-b4fd-32be8c54200c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:00.731706 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4eddd75f-8806-4b0d-b4fd-32be8c54200c tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1313 microversion: 2.1 time: 0.162554 Jun 30 18:27:00.732553 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 297/571] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:00 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:01.151725 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-584ba885-26e9-4f3a-a70c-099c92e99738 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:01.152420 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-584ba885-26e9-4f3a-a70c-099c92e99738 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:01.160233 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-584ba885-26e9-4f3a-a70c-099c92e99738 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:01.160815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-584ba885-26e9-4f3a-a70c-099c92e99738 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:01.161661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-584ba885-26e9-4f3a-a70c-099c92e99738 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:01.162351 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-584ba885-26e9-4f3a-a70c-099c92e99738 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:01.401134 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-584ba885-26e9-4f3a-a70c-099c92e99738 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:01.410023 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-584ba885-26e9-4f3a-a70c-099c92e99738 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1441 microversion: 2.1 time: 0.262419 Jun 30 18:27:01.410945 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 275/572] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:01 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1441 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:27:01.430615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-018c91e2-aff2-47c7-9267-8061a220ab9e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:01.431478 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-018c91e2-aff2-47c7-9267-8061a220ab9e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:01.437569 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-018c91e2-aff2-47c7-9267-8061a220ab9e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:01.438020 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-018c91e2-aff2-47c7-9267-8061a220ab9e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:01.438829 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-018c91e2-aff2-47c7-9267-8061a220ab9e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:01.439268 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-018c91e2-aff2-47c7-9267-8061a220ab9e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:01.589166 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-018c91e2-aff2-47c7-9267-8061a220ab9e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:01.597743 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-018c91e2-aff2-47c7-9267-8061a220ab9e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1441 microversion: 2.1 time: 0.171107 Jun 30 18:27:01.598244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 298/573] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:01 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1441 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:01.749206 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-245aaf09-b1ef-468e-a6f3-ea378d7a6a13 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:01.750074 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-245aaf09-b1ef-468e-a6f3-ea378d7a6a13 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:01.756903 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-245aaf09-b1ef-468e-a6f3-ea378d7a6a13 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:01.757633 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-245aaf09-b1ef-468e-a6f3-ea378d7a6a13 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:01.758700 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-245aaf09-b1ef-468e-a6f3-ea378d7a6a13 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:01.759385 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-245aaf09-b1ef-468e-a6f3-ea378d7a6a13 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:02.009130 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-245aaf09-b1ef-468e-a6f3-ea378d7a6a13 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:02.019110 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-245aaf09-b1ef-468e-a6f3-ea378d7a6a13 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1313 microversion: 2.1 time: 0.273746 Jun 30 18:27:02.019523 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 276/574] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:01 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:03.036094 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1ebe5706-59c1-42a9-aff3-2dc8f56208fe tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:03.036720 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1ebe5706-59c1-42a9-aff3-2dc8f56208fe tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:03.043618 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1ebe5706-59c1-42a9-aff3-2dc8f56208fe tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:03.043973 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1ebe5706-59c1-42a9-aff3-2dc8f56208fe tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:03.044782 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1ebe5706-59c1-42a9-aff3-2dc8f56208fe tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:03.045175 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1ebe5706-59c1-42a9-aff3-2dc8f56208fe tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:03.186570 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1ebe5706-59c1-42a9-aff3-2dc8f56208fe tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:03.194706 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1ebe5706-59c1-42a9-aff3-2dc8f56208fe tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1313 microversion: 2.1 time: 0.162918 Jun 30 18:27:03.195280 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 299/575] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:03 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:03.512583 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-77578591-fa6d-4f22-a002-87cd79465a16 req-3846bb97-6414-4507-954b-6b0b5c68a040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513aedba-0675-4c23-a0dc-c081a54704d9", "tag": "3d9c8a6c-255b-46d9-828b-11136e25b879"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:27:03.521105 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-77578591-fa6d-4f22-a002-87cd79465a16 req-3846bb97-6414-4507-954b-6b0b5c68a040 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:03.521544 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-77578591-fa6d-4f22-a002-87cd79465a16 req-3846bb97-6414-4507-954b-6b0b5c68a040 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:03.533832 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-77578591-fa6d-4f22-a002-87cd79465a16 req-3846bb97-6414-4507-954b-6b0b5c68a040 service nova] Creating event network-changed:3d9c8a6c-255b-46d9-828b-11136e25b879 for instance 513aedba-0675-4c23-a0dc-c081a54704d9 on hv-cinder-81268 Jun 30 18:27:03.539027 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-77578591-fa6d-4f22-a002-87cd79465a16 req-3846bb97-6414-4507-954b-6b0b5c68a040 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030084 Jun 30 18:27:03.542445 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 277/576] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:27:04.213817 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1df146c5-0c69-43c0-8d9b-2c68dbc92667 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:04.215555 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1df146c5-0c69-43c0-8d9b-2c68dbc92667 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:04.225099 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1df146c5-0c69-43c0-8d9b-2c68dbc92667 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:04.225552 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1df146c5-0c69-43c0-8d9b-2c68dbc92667 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:04.226325 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1df146c5-0c69-43c0-8d9b-2c68dbc92667 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:04.226940 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1df146c5-0c69-43c0-8d9b-2c68dbc92667 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:04.459957 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-1df146c5-0c69-43c0-8d9b-2c68dbc92667 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:04.467646 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1df146c5-0c69-43c0-8d9b-2c68dbc92667 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1313 microversion: 2.1 time: 0.259860 Jun 30 18:27:04.468230 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 300/577] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:04 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:27:05.485537 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b290130a-83f2-4c72-9cf8-588434cc6c7f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:05.486178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b290130a-83f2-4c72-9cf8-588434cc6c7f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:05.494090 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b290130a-83f2-4c72-9cf8-588434cc6c7f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:05.494574 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b290130a-83f2-4c72-9cf8-588434cc6c7f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:05.495353 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b290130a-83f2-4c72-9cf8-588434cc6c7f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:05.495786 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b290130a-83f2-4c72-9cf8-588434cc6c7f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:05.629143 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b290130a-83f2-4c72-9cf8-588434cc6c7f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:05.636512 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b290130a-83f2-4c72-9cf8-588434cc6c7f tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1313 microversion: 2.1 time: 0.156001 Jun 30 18:27:05.637074 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 278/578] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:05 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:06.653384 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b5050bb9-0abc-47de-bee1-ff74100eacec tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:06.654062 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b5050bb9-0abc-47de-bee1-ff74100eacec tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:06.660903 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b5050bb9-0abc-47de-bee1-ff74100eacec tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:06.661419 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b5050bb9-0abc-47de-bee1-ff74100eacec tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:06.662196 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b5050bb9-0abc-47de-bee1-ff74100eacec tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:06.662662 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b5050bb9-0abc-47de-bee1-ff74100eacec tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:06.932404 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-f90ad422-6d83-4d77-92c8-2ddc615cf92b req-5669a699-e0e9-4833-a962-1e7de0b6291f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345eb489-de32-4d6b-bbc6-1f342fe2bfca", "name": "network-vif-plugged", "status": "completed", "tag": "3384ebab-fbe3-4baa-af32-1d7ba69cf91b"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:27:06.942727 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-f90ad422-6d83-4d77-92c8-2ddc615cf92b req-5669a699-e0e9-4833-a962-1e7de0b6291f service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:06.943126 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-f90ad422-6d83-4d77-92c8-2ddc615cf92b req-5669a699-e0e9-4833-a962-1e7de0b6291f service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:06.956562 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-f90ad422-6d83-4d77-92c8-2ddc615cf92b req-5669a699-e0e9-4833-a962-1e7de0b6291f service nova] Creating event network-vif-plugged:3384ebab-fbe3-4baa-af32-1d7ba69cf91b for instance 345eb489-de32-4d6b-bbc6-1f342fe2bfca on hv-cinder-81268 Jun 30 18:27:06.961757 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-f90ad422-6d83-4d77-92c8-2ddc615cf92b req-5669a699-e0e9-4833-a962-1e7de0b6291f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Jun 30 18:27:06.962779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 279/579] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:27:07.073517 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b5050bb9-0abc-47de-bee1-ff74100eacec tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:07.082693 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b5050bb9-0abc-47de-bee1-ff74100eacec tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1313 microversion: 2.1 time: 0.433256 Jun 30 18:27:07.083284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 301/580] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:06 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:08.096786 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:08.097541 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=6 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:08.101986 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-412d110a-ebc4-4586-b71e-12e394bb7abd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:08.102736 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-412d110a-ebc4-4586-b71e-12e394bb7abd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:08.109810 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-412d110a-ebc4-4586-b71e-12e394bb7abd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:08.110249 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-412d110a-ebc4-4586-b71e-12e394bb7abd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:08.111518 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-412d110a-ebc4-4586-b71e-12e394bb7abd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:08.111946 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-412d110a-ebc4-4586-b71e-12e394bb7abd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:08.246007 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-412d110a-ebc4-4586-b71e-12e394bb7abd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:08.254069 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-412d110a-ebc4-4586-b71e-12e394bb7abd tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1313 microversion: 2.1 time: 0.158161 Jun 30 18:27:08.254676 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 280/581] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:08 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:09.270705 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-54e182f9-df59-4a5b-a387-7f1a9136b6de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:09.271371 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-54e182f9-df59-4a5b-a387-7f1a9136b6de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:09.273201 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:09.278545 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-54e182f9-df59-4a5b-a387-7f1a9136b6de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:09.278994 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-54e182f9-df59-4a5b-a387-7f1a9136b6de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:09.279770 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-54e182f9-df59-4a5b-a387-7f1a9136b6de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:09.280207 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-54e182f9-df59-4a5b-a387-7f1a9136b6de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:09.424031 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-54e182f9-df59-4a5b-a387-7f1a9136b6de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:09.432017 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-54e182f9-df59-4a5b-a387-7f1a9136b6de tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1497 microversion: 2.1 time: 0.165864 Jun 30 18:27:09.432615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 302/582] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:09 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:09.960477 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c0152b96-52a7-484f-9265-811ad91fbc45 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:09.961005 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c0152b96-52a7-484f-9265-811ad91fbc45 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:09.968730 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c0152b96-52a7-484f-9265-811ad91fbc45 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:09.969234 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c0152b96-52a7-484f-9265-811ad91fbc45 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:09.970626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c0152b96-52a7-484f-9265-811ad91fbc45 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:09.971099 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c0152b96-52a7-484f-9265-811ad91fbc45 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:10.001987 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c0152b96-52a7-484f-9265-811ad91fbc45 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:27:10.081862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-c0152b96-52a7-484f-9265-811ad91fbc45 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "DELETE /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 204 len: 0 microversion: 2.1 time: 0.124750 Jun 30 18:27:10.082800 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 281/583] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:27:09 2022] DELETE /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:27:10.091013 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-22ad4743-fe6c-434e-891c-00f6ac46e7a3 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:10.091624 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-22ad4743-fe6c-434e-891c-00f6ac46e7a3 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:10.098290 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-22ad4743-fe6c-434e-891c-00f6ac46e7a3 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:10.098788 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-22ad4743-fe6c-434e-891c-00f6ac46e7a3 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:10.099571 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-22ad4743-fe6c-434e-891c-00f6ac46e7a3 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:10.100001 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-22ad4743-fe6c-434e-891c-00f6ac46e7a3 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:10.236597 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-22ad4743-fe6c-434e-891c-00f6ac46e7a3 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:10.244766 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-22ad4743-fe6c-434e-891c-00f6ac46e7a3 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1503 microversion: 2.1 time: 0.157654 Jun 30 18:27:10.245339 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 303/584] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:10 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:11.263353 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-291a9832-af7f-4950-b8f0-dfa106b4b796 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:11.263998 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-291a9832-af7f-4950-b8f0-dfa106b4b796 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:11.270481 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-291a9832-af7f-4950-b8f0-dfa106b4b796 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:11.270928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-291a9832-af7f-4950-b8f0-dfa106b4b796 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:11.271695 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-291a9832-af7f-4950-b8f0-dfa106b4b796 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:11.272124 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-291a9832-af7f-4950-b8f0-dfa106b4b796 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:11.405634 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-291a9832-af7f-4950-b8f0-dfa106b4b796 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:11.413825 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-291a9832-af7f-4950-b8f0-dfa106b4b796 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1503 microversion: 2.1 time: 0.154666 Jun 30 18:27:11.414725 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 282/585] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:11 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:12.332277 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-5ade5c8b-f995-4ad7-b5d0-6709c7d10142 req-7cf6d8b4-1b2d-4a0c-a4c2-f72db7df5927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345eb489-de32-4d6b-bbc6-1f342fe2bfca", "name": "network-vif-deleted", "tag": "3384ebab-fbe3-4baa-af32-1d7ba69cf91b"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:27:12.343907 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-5ade5c8b-f995-4ad7-b5d0-6709c7d10142 req-7cf6d8b4-1b2d-4a0c-a4c2-f72db7df5927 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:12.349511 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-5ade5c8b-f995-4ad7-b5d0-6709c7d10142 req-7cf6d8b4-1b2d-4a0c-a4c2-f72db7df5927 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:12.359814 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:12.363698 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-5ade5c8b-f995-4ad7-b5d0-6709c7d10142 req-7cf6d8b4-1b2d-4a0c-a4c2-f72db7df5927 service nova] Creating event network-vif-deleted:3384ebab-fbe3-4baa-af32-1d7ba69cf91b for instance 345eb489-de32-4d6b-bbc6-1f342fe2bfca on hv-cinder-81268 Jun 30 18:27:12.369695 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-5ade5c8b-f995-4ad7-b5d0-6709c7d10142 req-7cf6d8b4-1b2d-4a0c-a4c2-f72db7df5927 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044863 Jun 30 18:27:12.370312 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 304/586] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:27:12.436229 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-e8d7191f-4a0b-4442-8d51-4058c1b2fdc7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:12.437266 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-e8d7191f-4a0b-4442-8d51-4058c1b2fdc7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:12.449878 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e8d7191f-4a0b-4442-8d51-4058c1b2fdc7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:12.450704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e8d7191f-4a0b-4442-8d51-4058c1b2fdc7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:12.452080 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e8d7191f-4a0b-4442-8d51-4058c1b2fdc7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:12.452840 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-e8d7191f-4a0b-4442-8d51-4058c1b2fdc7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:12.562602 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-e8d7191f-4a0b-4442-8d51-4058c1b2fdc7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e68d622a1c4e5892ea44b45257f133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbed76024fb401d9519d28dabbf6457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:12.575776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-e8d7191f-4a0b-4442-8d51-4058c1b2fdc7 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 200 len: 1298 microversion: 2.1 time: 0.146555 Jun 30 18:27:12.584951 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 283/587] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:12 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 1298 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:13.592937 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:13.593615 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] [instance: 345eb489-de32-4d6b-bbc6-1f342fe2bfca] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:13.600927 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:13.601371 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:13.602125 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:13.602583 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:13.618172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] HTTP exception thrown: Instance 345eb489-de32-4d6b-bbc6-1f342fe2bfca could not be found. Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Request method failure captured: Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca HTTP/1.1 Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiverP_lpotvu7FRU2CAvxI8ok8uvkXX0Xy22R6phwglrnxhUruGLqvUrdYv98p-duOnncTjF6hSM4reMybN2abMrDs_XvPIT0Mwge0oNvq0UKUxNqyDgtZmlBPMyBM19Jcsn5oML072NfMdeBHAIpJAS8uctXUcYdJCtBsfjfcJql7P4 Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: cbbed76024fb401d9519d28dabbf6457 Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-VolumesActionsTest-1558912358 Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:27:13.619808 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cbbed76024fb401d9519d28dabbf6457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cbbed76024fb401d9519d28dabbf6457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cbbed76024fb401d9519d28dabbf6457"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cbbed76024fb401d9519d28dabbf6457"}]}] Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-VolumesActionsTest-1558912358 Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: cbbed76024fb401d9519d28dabbf6457 Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-VolumesActionsTest-1558912358 Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-VolumesActionsTest-1558912358-project Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 83e68d622a1c4e5892ea44b45257f133 Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-VolumesActionsTest-1558912358-project Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 345eb489-de32-4d6b-bbc6-1f342fe2bfca could not be found. Jun 30 18:27:13.621327 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '345eb489-de32-4d6b-bbc6-1f342fe2bfca'} Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345eb489-de32-4d6b-bbc6-1f342fe2bfca could not be found. Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:27:13.622193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345eb489-de32-4d6b-bbc6-1f342fe2bfca could not be found. Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345eb489-de32-4d6b-bbc6-1f342fe2bfca could not be found. Jun 30 18:27:13.623549 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:27:13.624624 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] Returning 404 to user: Instance 345eb489-de32-4d6b-bbc6-1f342fe2bfca could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:27:13.624624 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-7d3bf1dc-2166-4f26-ab75-b827491da961 tempest-VolumesActionsTest-1558912358 tempest-VolumesActionsTest-1558912358-project] 10.222.0.16 "GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca" status: 404 len: 111 microversion: 2.1 time: 0.032709 Jun 30 18:27:13.628054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 305/588] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:13 2022] GET /compute/v2.1/servers/345eb489-de32-4d6b-bbc6-1f342fe2bfca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:27:48.424563 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-684522250", "imageRef": "2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7", "flavorRef": "452"}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:27:48.430498 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:48.431166 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:48.485465 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] validate_networks() for None {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:27:49.011370 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:27:49.011788 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:27:49.012254 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:27:49.012659 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:27:49.013066 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:27:49.023052 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:49.023504 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:49.024305 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:49.024773 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:49.043740 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Getting quotas for project 69923bd737bb4772852723c5cd99d57f. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:27:49.048338 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Getting quotas for user 13343af4cf404f0ea75ebd87eeb4d291 and project 69923bd737bb4772852723c5cd99d57f. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:27:49.060990 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:27:49.063302 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d3ce10d-282b-4a4f-ac8e-cdf8b8c037d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:27:49.113410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-8b35ee82-0a56-4789-9ab4-b4777d59ecf3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692864 Jun 30 18:27:49.114063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 284/589] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:27:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:27:49.126821 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-be437004-5446-4c24-9b82-d2aa007b44fd tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:49.127499 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-be437004-5446-4c24-9b82-d2aa007b44fd tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:49.131278 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=21 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:49.131938 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:49.192505 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-be437004-5446-4c24-9b82-d2aa007b44fd tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:49.199881 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-be437004-5446-4c24-9b82-d2aa007b44fd tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1214 microversion: 2.1 time: 0.076922 Jun 30 18:27:49.201041 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 306/590] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:49 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:50.219792 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ac3c35f5-c91b-42f5-b062-33231ad13b3c tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:50.220597 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ac3c35f5-c91b-42f5-b062-33231ad13b3c tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:50.227164 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ac3c35f5-c91b-42f5-b062-33231ad13b3c tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:50.227952 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ac3c35f5-c91b-42f5-b062-33231ad13b3c tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:50.228784 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ac3c35f5-c91b-42f5-b062-33231ad13b3c tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:50.229285 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ac3c35f5-c91b-42f5-b062-33231ad13b3c tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:50.295806 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ac3c35f5-c91b-42f5-b062-33231ad13b3c tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:50.306718 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ac3c35f5-c91b-42f5-b062-33231ad13b3c tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1284 microversion: 2.1 time: 0.093441 Jun 30 18:27:50.307387 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 285/591] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:50 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:51.324210 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2e3a3694-56d6-47d8-84eb-f81486d47432 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:51.325481 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-2e3a3694-56d6-47d8-84eb-f81486d47432 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:51.332342 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2e3a3694-56d6-47d8-84eb-f81486d47432 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:51.332783 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2e3a3694-56d6-47d8-84eb-f81486d47432 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:51.333701 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2e3a3694-56d6-47d8-84eb-f81486d47432 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:51.334284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2e3a3694-56d6-47d8-84eb-f81486d47432 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:51.549450 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2e3a3694-56d6-47d8-84eb-f81486d47432 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:51.557743 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2e3a3694-56d6-47d8-84eb-f81486d47432 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1314 microversion: 2.1 time: 0.237558 Jun 30 18:27:51.558556 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 307/592] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:51 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:51.895935 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-43cabae8-3fb3-41f9-bfc6-e8e58e24444b req-f2529769-675f-4041-889f-ad0ba2c43e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad7a1f7-f885-4904-950f-845f7bc32f3a", "tag": "7bbd0789-e3a3-4d6f-9f57-ef48b38916ff"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:27:51.912327 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-43cabae8-3fb3-41f9-bfc6-e8e58e24444b req-f2529769-675f-4041-889f-ad0ba2c43e1c service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:51.913205 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-43cabae8-3fb3-41f9-bfc6-e8e58e24444b req-f2529769-675f-4041-889f-ad0ba2c43e1c service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:51.928373 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-43cabae8-3fb3-41f9-bfc6-e8e58e24444b req-f2529769-675f-4041-889f-ad0ba2c43e1c service nova] Creating event network-changed:7bbd0789-e3a3-4d6f-9f57-ef48b38916ff for instance 5ad7a1f7-f885-4904-950f-845f7bc32f3a on hv-cinder-81268 Jun 30 18:27:51.934038 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-43cabae8-3fb3-41f9-bfc6-e8e58e24444b req-f2529769-675f-4041-889f-ad0ba2c43e1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042379 Jun 30 18:27:51.934936 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 286/593] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:27:52.574788 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e9ff0f3a-ad61-46c7-a169-786bfa420471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:52.575392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e9ff0f3a-ad61-46c7-a169-786bfa420471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:52.581340 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e9ff0f3a-ad61-46c7-a169-786bfa420471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:52.581779 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e9ff0f3a-ad61-46c7-a169-786bfa420471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:52.582544 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e9ff0f3a-ad61-46c7-a169-786bfa420471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:52.582971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e9ff0f3a-ad61-46c7-a169-786bfa420471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:52.722632 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e9ff0f3a-ad61-46c7-a169-786bfa420471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:52.730052 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e9ff0f3a-ad61-46c7-a169-786bfa420471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1314 microversion: 2.1 time: 0.159079 Jun 30 18:27:52.730644 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 308/594] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:52 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:53.748392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-81b2463f-0617-43a6-bc78-0864c7a29c2a tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:53.749751 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-81b2463f-0617-43a6-bc78-0864c7a29c2a tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:53.755982 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-81b2463f-0617-43a6-bc78-0864c7a29c2a tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:53.756430 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-81b2463f-0617-43a6-bc78-0864c7a29c2a tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:53.757189 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-81b2463f-0617-43a6-bc78-0864c7a29c2a tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:53.757622 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-81b2463f-0617-43a6-bc78-0864c7a29c2a tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:53.891222 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-81b2463f-0617-43a6-bc78-0864c7a29c2a tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:53.898673 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-81b2463f-0617-43a6-bc78-0864c7a29c2a tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1314 microversion: 2.1 time: 0.154873 Jun 30 18:27:53.899250 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 287/595] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:53 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:54.915594 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-800d26f9-ad71-47e0-aeb2-ccb320bc00b3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:54.916201 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-800d26f9-ad71-47e0-aeb2-ccb320bc00b3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:54.922705 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-800d26f9-ad71-47e0-aeb2-ccb320bc00b3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:54.923150 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-800d26f9-ad71-47e0-aeb2-ccb320bc00b3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:54.923905 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-800d26f9-ad71-47e0-aeb2-ccb320bc00b3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:54.924338 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-800d26f9-ad71-47e0-aeb2-ccb320bc00b3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:55.128570 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-800d26f9-ad71-47e0-aeb2-ccb320bc00b3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:55.138957 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-800d26f9-ad71-47e0-aeb2-ccb320bc00b3 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1314 microversion: 2.1 time: 0.227050 Jun 30 18:27:55.140406 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 309/596] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:54 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:56.156912 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0c79ed35-52f2-4a60-928c-2ab3739933f4 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:56.157552 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0c79ed35-52f2-4a60-928c-2ab3739933f4 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:56.164294 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c79ed35-52f2-4a60-928c-2ab3739933f4 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:56.164738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c79ed35-52f2-4a60-928c-2ab3739933f4 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:56.165538 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c79ed35-52f2-4a60-928c-2ab3739933f4 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:56.165966 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c79ed35-52f2-4a60-928c-2ab3739933f4 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:56.302608 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0c79ed35-52f2-4a60-928c-2ab3739933f4 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:56.310398 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0c79ed35-52f2-4a60-928c-2ab3739933f4 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1314 microversion: 2.1 time: 0.157966 Jun 30 18:27:56.310974 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 288/597] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:56 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:57.069412 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:27:57.069659 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:27:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:27:57.108779 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-d8cf0dc1-01e4-48d7-8062-4f739ed8cacc req-f575f7b5-024b-4ce0-a117-c11d3d724e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad7a1f7-f885-4904-950f-845f7bc32f3a", "name": "network-vif-plugged", "status": "completed", "tag": "7bbd0789-e3a3-4d6f-9f57-ef48b38916ff"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:27:57.118699 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-d8cf0dc1-01e4-48d7-8062-4f739ed8cacc req-f575f7b5-024b-4ce0-a117-c11d3d724e97 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:57.119173 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-d8cf0dc1-01e4-48d7-8062-4f739ed8cacc req-f575f7b5-024b-4ce0-a117-c11d3d724e97 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:57.132542 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-d8cf0dc1-01e4-48d7-8062-4f739ed8cacc req-f575f7b5-024b-4ce0-a117-c11d3d724e97 service nova] Creating event network-vif-plugged:7bbd0789-e3a3-4d6f-9f57-ef48b38916ff for instance 5ad7a1f7-f885-4904-950f-845f7bc32f3a on hv-cinder-81268 Jun 30 18:27:57.137807 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-d8cf0dc1-01e4-48d7-8062-4f739ed8cacc req-f575f7b5-024b-4ce0-a117-c11d3d724e97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Jun 30 18:27:57.138438 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 310/598] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:27:57.327572 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6427ad0a-c252-4836-bc64-0e3083169341 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:57.328186 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6427ad0a-c252-4836-bc64-0e3083169341 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:57.334872 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6427ad0a-c252-4836-bc64-0e3083169341 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:57.335326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6427ad0a-c252-4836-bc64-0e3083169341 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:57.336174 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6427ad0a-c252-4836-bc64-0e3083169341 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:57.336610 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6427ad0a-c252-4836-bc64-0e3083169341 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:57.474201 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6427ad0a-c252-4836-bc64-0e3083169341 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:57.481718 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6427ad0a-c252-4836-bc64-0e3083169341 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1314 microversion: 2.1 time: 0.158533 Jun 30 18:27:57.482278 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 289/599] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:57 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:58.501530 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-29b2c609-74b6-4327-96b5-2708a9c4b471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:58.502216 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-29b2c609-74b6-4327-96b5-2708a9c4b471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:58.508415 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-29b2c609-74b6-4327-96b5-2708a9c4b471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:58.508852 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-29b2c609-74b6-4327-96b5-2708a9c4b471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:58.509598 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-29b2c609-74b6-4327-96b5-2708a9c4b471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:58.510022 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-29b2c609-74b6-4327-96b5-2708a9c4b471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:58.868893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-29b2c609-74b6-4327-96b5-2708a9c4b471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:27:58.876267 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-29b2c609-74b6-4327-96b5-2708a9c4b471 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1314 microversion: 2.1 time: 0.379579 Jun 30 18:27:58.876832 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 311/600] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:58 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:27:59.218414 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:27:59.218658 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:27:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:27:59.893115 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-27dd741c-2772-4d66-9032-5cd683532acc tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:27:59.893726 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-27dd741c-2772-4d66-9032-5cd683532acc tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:27:59.896063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:59.896866 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=6 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:27:59.902995 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-27dd741c-2772-4d66-9032-5cd683532acc tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:59.903447 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-27dd741c-2772-4d66-9032-5cd683532acc tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:27:59.904217 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-27dd741c-2772-4d66-9032-5cd683532acc tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:27:59.904654 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-27dd741c-2772-4d66-9032-5cd683532acc tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:00.036605 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-27dd741c-2772-4d66-9032-5cd683532acc tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:00.045100 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-27dd741c-2772-4d66-9032-5cd683532acc tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1463 microversion: 2.1 time: 0.155761 Jun 30 18:28:00.046708 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 290/601] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:27:59 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:00.090246 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8bd246bf-ec2b-4591-92fa-e7fc7910183e tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:00.090903 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8bd246bf-ec2b-4591-92fa-e7fc7910183e tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:00.092913 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:28:00.098853 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8bd246bf-ec2b-4591-92fa-e7fc7910183e tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:00.099302 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8bd246bf-ec2b-4591-92fa-e7fc7910183e tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:00.100098 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8bd246bf-ec2b-4591-92fa-e7fc7910183e tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:00.100512 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8bd246bf-ec2b-4591-92fa-e7fc7910183e tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:00.126577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8bd246bf-ec2b-4591-92fa-e7fc7910183e tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Going to try to terminate instance {{(pid=129370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:28:00.206619 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8bd246bf-ec2b-4591-92fa-e7fc7910183e tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 204 len: 0 microversion: 2.1 time: 0.119941 Jun 30 18:28:00.207110 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 312/602] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:28:00 2022] DELETE /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:28:00.216734 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-afdbca1f-94c7-4fbe-bd7a-bb05df688eec tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:00.217966 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-afdbca1f-94c7-4fbe-bd7a-bb05df688eec tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:00.224327 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-afdbca1f-94c7-4fbe-bd7a-bb05df688eec tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:00.224889 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-afdbca1f-94c7-4fbe-bd7a-bb05df688eec tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:00.225682 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-afdbca1f-94c7-4fbe-bd7a-bb05df688eec tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:00.226109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-afdbca1f-94c7-4fbe-bd7a-bb05df688eec tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:00.357550 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-afdbca1f-94c7-4fbe-bd7a-bb05df688eec tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:00.365540 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-afdbca1f-94c7-4fbe-bd7a-bb05df688eec tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1469 microversion: 2.1 time: 0.152759 Jun 30 18:28:00.367960 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 291/603] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:00 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:01.382833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e94240dd-f0f3-444f-a937-1b2306903e10 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:01.383534 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e94240dd-f0f3-444f-a937-1b2306903e10 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:01.390315 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e94240dd-f0f3-444f-a937-1b2306903e10 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:01.390784 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e94240dd-f0f3-444f-a937-1b2306903e10 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:01.391550 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e94240dd-f0f3-444f-a937-1b2306903e10 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:01.391985 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e94240dd-f0f3-444f-a937-1b2306903e10 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:01.527365 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e94240dd-f0f3-444f-a937-1b2306903e10 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:01.538069 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e94240dd-f0f3-444f-a937-1b2306903e10 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1469 microversion: 2.1 time: 0.159328 Jun 30 18:28:01.538953 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 313/604] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:01 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:02.464356 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-47531f99-3215-4fbb-b4a5-16154856cae5 req-a1a70954-092d-422c-ba37-160d1f08a304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad7a1f7-f885-4904-950f-845f7bc32f3a", "name": "network-vif-deleted", "tag": "7bbd0789-e3a3-4d6f-9f57-ef48b38916ff"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:28:02.474594 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-47531f99-3215-4fbb-b4a5-16154856cae5 req-a1a70954-092d-422c-ba37-160d1f08a304 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:02.475046 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-47531f99-3215-4fbb-b4a5-16154856cae5 req-a1a70954-092d-422c-ba37-160d1f08a304 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:02.489738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-47531f99-3215-4fbb-b4a5-16154856cae5 req-a1a70954-092d-422c-ba37-160d1f08a304 service nova] Creating event network-vif-deleted:7bbd0789-e3a3-4d6f-9f57-ef48b38916ff for instance 5ad7a1f7-f885-4904-950f-845f7bc32f3a on hv-cinder-81268 Jun 30 18:28:02.495947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-47531f99-3215-4fbb-b4a5-16154856cae5 req-a1a70954-092d-422c-ba37-160d1f08a304 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035685 Jun 30 18:28:02.497076 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 292/605] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:28:02.560496 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:02.561797 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:02.569349 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:02.569971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:02.570880 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:02.571384 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:02.604902 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:02.605405 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:02.605795 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.objects.instance [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lazy-loading 'fault' on Instance uuid 5ad7a1f7-f885-4904-950f-845f7bc32f3a {{(pid=129370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:28:02.652780 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13343af4cf404f0ea75ebd87eeb4d291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69923bd737bb4772852723c5cd99d57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:28:02.661591 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-42398f88-009c-4af9-8b56-f76b642becbb tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 200 len: 1304 microversion: 2.1 time: 0.107023 Jun 30 18:28:02.662202 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 314/606] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:02 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:28:03.680363 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:28:03.681053 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] [instance: 5ad7a1f7-f885-4904-950f-845f7bc32f3a] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:28:03.687217 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:03.687659 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:03.688414 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:28:03.688840 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:28:03.702065 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] HTTP exception thrown: Instance 5ad7a1f7-f885-4904-950f-845f7bc32f3a could not be found. Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Request method failure captured: Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a HTTP/1.1 Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABivesi10CW4PVj2nOEo1-Mb8M4yBsAgNkWOPeGTS4Sm2u9zRUb3oX_612rS7hywRQ2bZ_hpEUaHCy9b0-O_OeJ9NWxIbrvEZmKZtodaomezx1pK0ss-tX5M50TJowLuYrQ585osHAhVbNvFaRuuqrf_GeXAkdoSqqvSuruT79nidST-gM Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: 69923bd737bb4772852723c5cd99d57f Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-VolumesNegativeTest-309422420 Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:28:03.703709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/69923bd737bb4772852723c5cd99d57f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_69923bd737bb4772852723c5cd99d57f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69923bd737bb4772852723c5cd99d57f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/69923bd737bb4772852723c5cd99d57f"}]}] Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-VolumesNegativeTest-309422420 Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: 69923bd737bb4772852723c5cd99d57f Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-VolumesNegativeTest-309422420 Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-VolumesNegativeTest-309422420-project Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 13343af4cf404f0ea75ebd87eeb4d291 Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-VolumesNegativeTest-309422420-project Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 5ad7a1f7-f885-4904-950f-845f7bc32f3a could not be found. Jun 30 18:28:03.706078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '5ad7a1f7-f885-4904-950f-845f7bc32f3a'} Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad7a1f7-f885-4904-950f-845f7bc32f3a could not be found. Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:28:03.707187 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad7a1f7-f885-4904-950f-845f7bc32f3a could not be found. Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad7a1f7-f885-4904-950f-845f7bc32f3a could not be found. Jun 30 18:28:03.708337 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:28:03.709396 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] Returning 404 to user: Instance 5ad7a1f7-f885-4904-950f-845f7bc32f3a could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:28:03.709396 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-42b5283e-9079-4bc7-aef8-600f2831f345 tempest-VolumesNegativeTest-309422420 tempest-VolumesNegativeTest-309422420-project] 10.222.0.16 "GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a" status: 404 len: 111 microversion: 2.1 time: 0.029565 Jun 30 18:28:03.709396 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 293/607] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:28:03 2022] GET /compute/v2.1/servers/5ad7a1f7-f885-4904-950f-845f7bc32f3a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:29:44.187247 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-1853f6e1-98e7-4d4a-b2cb-383b7057e917 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:44.187947 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-1853f6e1-98e7-4d4a-b2cb-383b7057e917 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:44.190935 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:44.191722 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:44.199876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1853f6e1-98e7-4d4a-b2cb-383b7057e917 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:44.200425 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1853f6e1-98e7-4d4a-b2cb-383b7057e917 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:44.201391 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1853f6e1-98e7-4d4a-b2cb-383b7057e917 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:44.201883 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-1853f6e1-98e7-4d4a-b2cb-383b7057e917 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:44.237371 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.objects.instance [None req-1853f6e1-98e7-4d4a-b2cb-383b7057e917 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lazy-loading 'flavor' on Instance uuid 513aedba-0675-4c23-a0dc-c081a54704d9 {{(pid=129370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:29:44.385769 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-1853f6e1-98e7-4d4a-b2cb-383b7057e917 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "POST /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9/action" status: 202 len: 0 microversion: 2.1 time: 0.204996 Jun 30 18:29:44.386390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 315/608] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 18:29:44 2022] POST /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 18:29:44.397225 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-80531221-44c3-41d2-b067-797d2019f3cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:44.398097 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-80531221-44c3-41d2-b067-797d2019f3cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:44.401007 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:44.401830 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=44 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:29:44.410021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-80531221-44c3-41d2-b067-797d2019f3cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:44.410696 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-80531221-44c3-41d2-b067-797d2019f3cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:44.411768 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-80531221-44c3-41d2-b067-797d2019f3cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:44.412328 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-80531221-44c3-41d2-b067-797d2019f3cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:44.582174 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-80531221-44c3-41d2-b067-797d2019f3cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:44.590715 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-80531221-44c3-41d2-b067-797d2019f3cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.199560 Jun 30 18:29:44.591401 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 294/609] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:44 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:45.609444 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-424d2295-091e-4565-844e-1aaaba18ce1f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:45.610174 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-424d2295-091e-4565-844e-1aaaba18ce1f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:45.616618 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-424d2295-091e-4565-844e-1aaaba18ce1f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:45.617064 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-424d2295-091e-4565-844e-1aaaba18ce1f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:45.617854 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-424d2295-091e-4565-844e-1aaaba18ce1f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:45.618854 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-424d2295-091e-4565-844e-1aaaba18ce1f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:45.753165 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-424d2295-091e-4565-844e-1aaaba18ce1f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:45.760737 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-424d2295-091e-4565-844e-1aaaba18ce1f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.155525 Jun 30 18:29:45.761295 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 316/610] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:45 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:46.302109 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:29:46.302369 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:29:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:29:46.779048 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-75866670-b8e7-4604-827d-ce6c348b4940 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:46.779641 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-75866670-b8e7-4604-827d-ce6c348b4940 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:46.786446 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-75866670-b8e7-4604-827d-ce6c348b4940 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:46.786902 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-75866670-b8e7-4604-827d-ce6c348b4940 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:46.787668 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-75866670-b8e7-4604-827d-ce6c348b4940 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:46.788104 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-75866670-b8e7-4604-827d-ce6c348b4940 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:46.924082 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-75866670-b8e7-4604-827d-ce6c348b4940 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:46.932429 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-75866670-b8e7-4604-827d-ce6c348b4940 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.157294 Jun 30 18:29:46.933065 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 295/611] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:46 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:47.951167 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-dc331a9c-83b4-4d4a-9d1a-fa8daaaed8f8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:47.951806 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-dc331a9c-83b4-4d4a-9d1a-fa8daaaed8f8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:47.963774 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dc331a9c-83b4-4d4a-9d1a-fa8daaaed8f8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:47.964237 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dc331a9c-83b4-4d4a-9d1a-fa8daaaed8f8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:47.965188 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dc331a9c-83b4-4d4a-9d1a-fa8daaaed8f8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:47.965627 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dc331a9c-83b4-4d4a-9d1a-fa8daaaed8f8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:48.108881 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-dc331a9c-83b4-4d4a-9d1a-fa8daaaed8f8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:48.116687 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-dc331a9c-83b4-4d4a-9d1a-fa8daaaed8f8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.169641 Jun 30 18:29:48.117337 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 317/612] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:47 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:49.134955 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-def5fb3b-5dac-4b2e-a6ce-021947cab14b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:49.135564 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-def5fb3b-5dac-4b2e-a6ce-021947cab14b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:49.142320 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-def5fb3b-5dac-4b2e-a6ce-021947cab14b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:49.142791 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-def5fb3b-5dac-4b2e-a6ce-021947cab14b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:49.143562 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-def5fb3b-5dac-4b2e-a6ce-021947cab14b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:49.144011 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-def5fb3b-5dac-4b2e-a6ce-021947cab14b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:49.280167 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-def5fb3b-5dac-4b2e-a6ce-021947cab14b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:49.289403 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-def5fb3b-5dac-4b2e-a6ce-021947cab14b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.159030 Jun 30 18:29:49.290597 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 296/613] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:49 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:50.308103 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7283de84-f075-4af4-bf68-ff01d72b5de8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:50.308705 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-7283de84-f075-4af4-bf68-ff01d72b5de8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:50.314741 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7283de84-f075-4af4-bf68-ff01d72b5de8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:50.315181 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7283de84-f075-4af4-bf68-ff01d72b5de8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:50.315934 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7283de84-f075-4af4-bf68-ff01d72b5de8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:50.316357 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7283de84-f075-4af4-bf68-ff01d72b5de8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:50.448264 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-7283de84-f075-4af4-bf68-ff01d72b5de8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:50.456000 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-7283de84-f075-4af4-bf68-ff01d72b5de8 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.151705 Jun 30 18:29:50.456578 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 318/614] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:50 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:51.476287 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1ce49032-e2f5-460d-b07a-8fd764f79868 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:51.476896 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1ce49032-e2f5-460d-b07a-8fd764f79868 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:51.484034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1ce49032-e2f5-460d-b07a-8fd764f79868 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:51.484494 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1ce49032-e2f5-460d-b07a-8fd764f79868 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:51.485288 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1ce49032-e2f5-460d-b07a-8fd764f79868 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:51.486280 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1ce49032-e2f5-460d-b07a-8fd764f79868 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:51.628618 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1ce49032-e2f5-460d-b07a-8fd764f79868 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:51.637392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1ce49032-e2f5-460d-b07a-8fd764f79868 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.165014 Jun 30 18:29:51.637969 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 297/615] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:51 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:52.655044 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ad186043-2c97-4101-9326-cc2928a4d8d6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:52.655577 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ad186043-2c97-4101-9326-cc2928a4d8d6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:52.661722 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ad186043-2c97-4101-9326-cc2928a4d8d6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:52.662195 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ad186043-2c97-4101-9326-cc2928a4d8d6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:52.662995 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ad186043-2c97-4101-9326-cc2928a4d8d6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:52.663428 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-ad186043-2c97-4101-9326-cc2928a4d8d6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:52.801489 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-ad186043-2c97-4101-9326-cc2928a4d8d6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:52.809626 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ad186043-2c97-4101-9326-cc2928a4d8d6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.158580 Jun 30 18:29:52.810208 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 319/616] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:52 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:53.828096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-227b2b6d-25c8-4a01-ab4d-d8fd1b2d5cb7 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:53.828720 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-227b2b6d-25c8-4a01-ab4d-d8fd1b2d5cb7 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:53.835503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-227b2b6d-25c8-4a01-ab4d-d8fd1b2d5cb7 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:53.835956 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-227b2b6d-25c8-4a01-ab4d-d8fd1b2d5cb7 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:53.836798 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-227b2b6d-25c8-4a01-ab4d-d8fd1b2d5cb7 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:53.837234 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-227b2b6d-25c8-4a01-ab4d-d8fd1b2d5cb7 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:53.979079 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-227b2b6d-25c8-4a01-ab4d-d8fd1b2d5cb7 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:53.994025 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-227b2b6d-25c8-4a01-ab4d-d8fd1b2d5cb7 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.169298 Jun 30 18:29:53.995146 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 298/617] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:53 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:55.016876 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b14a6a07-b444-44a8-a25c-1089a54bbeeb tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:55.017836 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b14a6a07-b444-44a8-a25c-1089a54bbeeb tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:55.025226 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b14a6a07-b444-44a8-a25c-1089a54bbeeb tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:55.025694 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b14a6a07-b444-44a8-a25c-1089a54bbeeb tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:55.026479 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b14a6a07-b444-44a8-a25c-1089a54bbeeb tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:55.026916 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b14a6a07-b444-44a8-a25c-1089a54bbeeb tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:55.261664 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b14a6a07-b444-44a8-a25c-1089a54bbeeb tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:55.277181 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b14a6a07-b444-44a8-a25c-1089a54bbeeb tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.268193 Jun 30 18:29:55.278236 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 320/618] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:55 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:56.295415 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5edf72b0-9ec1-4182-8a43-95b638c97663 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:56.295968 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5edf72b0-9ec1-4182-8a43-95b638c97663 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:56.302794 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5edf72b0-9ec1-4182-8a43-95b638c97663 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:56.303239 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5edf72b0-9ec1-4182-8a43-95b638c97663 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:56.303998 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5edf72b0-9ec1-4182-8a43-95b638c97663 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:56.304427 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5edf72b0-9ec1-4182-8a43-95b638c97663 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:56.445344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-5edf72b0-9ec1-4182-8a43-95b638c97663 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:56.456162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5edf72b0-9ec1-4182-8a43-95b638c97663 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.164124 Jun 30 18:29:56.456162 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 299/619] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:56 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:57.479706 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-0c7f4a4b-89f3-4642-83bf-6c802b73c12f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:57.480933 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-0c7f4a4b-89f3-4642-83bf-6c802b73c12f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:57.487938 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0c7f4a4b-89f3-4642-83bf-6c802b73c12f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:57.488389 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0c7f4a4b-89f3-4642-83bf-6c802b73c12f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:57.489159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0c7f4a4b-89f3-4642-83bf-6c802b73c12f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:57.489670 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0c7f4a4b-89f3-4642-83bf-6c802b73c12f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:57.663214 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-0c7f4a4b-89f3-4642-83bf-6c802b73c12f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:57.671238 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-0c7f4a4b-89f3-4642-83bf-6c802b73c12f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.200863 Jun 30 18:29:57.671811 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 321/620] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:57 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:58.689448 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-60a0db70-b250-4362-b0bd-6fdcd442384f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:58.690051 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-60a0db70-b250-4362-b0bd-6fdcd442384f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:58.696819 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-60a0db70-b250-4362-b0bd-6fdcd442384f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:58.697254 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-60a0db70-b250-4362-b0bd-6fdcd442384f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:58.698024 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-60a0db70-b250-4362-b0bd-6fdcd442384f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:58.698478 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-60a0db70-b250-4362-b0bd-6fdcd442384f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:58.835159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-60a0db70-b250-4362-b0bd-6fdcd442384f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:58.843441 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-60a0db70-b250-4362-b0bd-6fdcd442384f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1507 microversion: 2.1 time: 0.157916 Jun 30 18:29:58.844019 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 300/621] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:58 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:58.860654 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5c4fa80e-41fe-455b-9a5d-26f10c1046b9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:58.861227 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5c4fa80e-41fe-455b-9a5d-26f10c1046b9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:58.867986 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5c4fa80e-41fe-455b-9a5d-26f10c1046b9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:58.868433 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5c4fa80e-41fe-455b-9a5d-26f10c1046b9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:58.869198 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5c4fa80e-41fe-455b-9a5d-26f10c1046b9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:58.869633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5c4fa80e-41fe-455b-9a5d-26f10c1046b9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:58.969831 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5c4fa80e-41fe-455b-9a5d-26f10c1046b9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "POST /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9/action" status: 202 len: 0 microversion: 2.1 time: 0.112998 Jun 30 18:29:58.971130 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 322/622] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Jun 30 18:29:58 2022] POST /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 18:29:58.983408 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d78e903e-7ff0-4282-9b31-dea81d4b3c4e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:29:58.984586 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d78e903e-7ff0-4282-9b31-dea81d4b3c4e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:29:58.996286 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d78e903e-7ff0-4282-9b31-dea81d4b3c4e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:58.997263 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d78e903e-7ff0-4282-9b31-dea81d4b3c4e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:58.999049 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d78e903e-7ff0-4282-9b31-dea81d4b3c4e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:58.999994 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d78e903e-7ff0-4282-9b31-dea81d4b3c4e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:59.178966 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d78e903e-7ff0-4282-9b31-dea81d4b3c4e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:29:59.192497 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d78e903e-7ff0-4282-9b31-dea81d4b3c4e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1515 microversion: 2.1 time: 0.216922 Jun 30 18:29:59.193645 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 301/623] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:29:58 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:29:59.754283 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-a0da3480-a738-4851-a13e-0bc1cc7e285b req-a4a493e0-be53-46ed-8061-3cd1e88f2d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513aedba-0675-4c23-a0dc-c081a54704d9", "name": "network-vif-unplugged", "status": "completed", "tag": "3d9c8a6c-255b-46d9-828b-11136e25b879"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:29:59.763613 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-a0da3480-a738-4851-a13e-0bc1cc7e285b req-a4a493e0-be53-46ed-8061-3cd1e88f2d9f service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:29:59.764482 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-a0da3480-a738-4851-a13e-0bc1cc7e285b req-a4a493e0-be53-46ed-8061-3cd1e88f2d9f service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:29:59.780293 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.compute.server_external_events [req-a0da3480-a738-4851-a13e-0bc1cc7e285b req-a4a493e0-be53-46ed-8061-3cd1e88f2d9f service nova] Unable to find a host for instance 513aedba-0675-4c23-a0dc-c081a54704d9. Dropping event network-vif-unplugged {{(pid=129370) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 18:29:59.781337 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-a0da3480-a738-4851-a13e-0bc1cc7e285b req-a4a493e0-be53-46ed-8061-3cd1e88f2d9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030729 Jun 30 18:29:59.782022 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 323/624] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 30 18:30:00.215546 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-a9cc55f3-4b61-4fab-9c44-81d91e921e27 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:00.216168 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-a9cc55f3-4b61-4fab-9c44-81d91e921e27 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:00.222788 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a9cc55f3-4b61-4fab-9c44-81d91e921e27 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:00.223239 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a9cc55f3-4b61-4fab-9c44-81d91e921e27 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:00.224021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a9cc55f3-4b61-4fab-9c44-81d91e921e27 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:00.224456 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-a9cc55f3-4b61-4fab-9c44-81d91e921e27 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:00.365380 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-a9cc55f3-4b61-4fab-9c44-81d91e921e27 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:00.374798 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-a9cc55f3-4b61-4fab-9c44-81d91e921e27 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1517 microversion: 2.1 time: 0.164140 Jun 30 18:30:00.375407 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 302/625] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:00 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:01.393231 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-706a0a22-8d7f-415b-816a-a8f6e383e601 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:01.393987 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-706a0a22-8d7f-415b-816a-a8f6e383e601 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:01.400229 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-706a0a22-8d7f-415b-816a-a8f6e383e601 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:01.400770 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-706a0a22-8d7f-415b-816a-a8f6e383e601 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:01.401601 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-706a0a22-8d7f-415b-816a-a8f6e383e601 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:01.402051 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-706a0a22-8d7f-415b-816a-a8f6e383e601 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:01.612250 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-706a0a22-8d7f-415b-816a-a8f6e383e601 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:01.620796 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-706a0a22-8d7f-415b-816a-a8f6e383e601 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.231450 Jun 30 18:30:01.621368 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 324/626] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:01 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:02.639173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-67dc0b7b-a9c6-44d9-a09e-87bc62d593f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:02.639852 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-67dc0b7b-a9c6-44d9-a09e-87bc62d593f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:02.646093 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-67dc0b7b-a9c6-44d9-a09e-87bc62d593f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:02.646587 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-67dc0b7b-a9c6-44d9-a09e-87bc62d593f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:02.647359 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-67dc0b7b-a9c6-44d9-a09e-87bc62d593f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:02.647795 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-67dc0b7b-a9c6-44d9-a09e-87bc62d593f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:02.808475 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-67dc0b7b-a9c6-44d9-a09e-87bc62d593f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:02.818434 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-67dc0b7b-a9c6-44d9-a09e-87bc62d593f6 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.183197 Jun 30 18:30:02.819013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 303/627] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:02 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:03.835586 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-0db55797-4dd3-4e59-a283-b833cc804ff9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:03.836766 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-0db55797-4dd3-4e59-a283-b833cc804ff9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:03.842785 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0db55797-4dd3-4e59-a283-b833cc804ff9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:03.843226 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0db55797-4dd3-4e59-a283-b833cc804ff9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:03.844000 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0db55797-4dd3-4e59-a283-b833cc804ff9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:03.844427 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0db55797-4dd3-4e59-a283-b833cc804ff9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:03.981131 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-0db55797-4dd3-4e59-a283-b833cc804ff9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:03.988711 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-0db55797-4dd3-4e59-a283-b833cc804ff9 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.156938 Jun 30 18:30:03.989285 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 325/628] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:03 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:05.006592 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b1e2bc89-21bd-456b-bc02-6399dc54e905 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:05.007199 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b1e2bc89-21bd-456b-bc02-6399dc54e905 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:05.013979 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1e2bc89-21bd-456b-bc02-6399dc54e905 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:05.014464 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1e2bc89-21bd-456b-bc02-6399dc54e905 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:05.015221 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1e2bc89-21bd-456b-bc02-6399dc54e905 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:05.015657 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b1e2bc89-21bd-456b-bc02-6399dc54e905 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:05.146949 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b1e2bc89-21bd-456b-bc02-6399dc54e905 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:05.155306 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b1e2bc89-21bd-456b-bc02-6399dc54e905 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.152568 Jun 30 18:30:05.155877 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 304/629] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:05 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:06.172871 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-dac8bfaf-e745-4238-b7d0-5d64af8d2358 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:06.173680 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-dac8bfaf-e745-4238-b7d0-5d64af8d2358 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:06.179937 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dac8bfaf-e745-4238-b7d0-5d64af8d2358 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:06.180379 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dac8bfaf-e745-4238-b7d0-5d64af8d2358 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:06.181140 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dac8bfaf-e745-4238-b7d0-5d64af8d2358 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:06.181566 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-dac8bfaf-e745-4238-b7d0-5d64af8d2358 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:06.316030 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-dac8bfaf-e745-4238-b7d0-5d64af8d2358 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:06.324590 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-dac8bfaf-e745-4238-b7d0-5d64af8d2358 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.155648 Jun 30 18:30:06.325160 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 326/630] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:06 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:07.342503 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-63411cc5-cde8-4417-a3c3-3d0ba4ce95cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:07.343112 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-63411cc5-cde8-4417-a3c3-3d0ba4ce95cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:07.349992 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-63411cc5-cde8-4417-a3c3-3d0ba4ce95cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:07.350487 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-63411cc5-cde8-4417-a3c3-3d0ba4ce95cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:07.351863 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-63411cc5-cde8-4417-a3c3-3d0ba4ce95cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:07.352301 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-63411cc5-cde8-4417-a3c3-3d0ba4ce95cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:07.490629 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-63411cc5-cde8-4417-a3c3-3d0ba4ce95cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:07.498381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-63411cc5-cde8-4417-a3c3-3d0ba4ce95cc tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.159787 Jun 30 18:30:07.498958 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 305/631] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:07 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:08.516473 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-103bc6eb-7a18-48b0-8a65-0f397c30972e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:08.517070 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-103bc6eb-7a18-48b0-8a65-0f397c30972e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:08.523328 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-103bc6eb-7a18-48b0-8a65-0f397c30972e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:08.523775 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-103bc6eb-7a18-48b0-8a65-0f397c30972e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:08.524538 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-103bc6eb-7a18-48b0-8a65-0f397c30972e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:08.524973 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-103bc6eb-7a18-48b0-8a65-0f397c30972e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:08.660532 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-103bc6eb-7a18-48b0-8a65-0f397c30972e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:08.668329 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-103bc6eb-7a18-48b0-8a65-0f397c30972e tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.155675 Jun 30 18:30:08.668905 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 327/632] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:08 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:09.685820 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b7add61b-fa61-4ea6-b817-98d79ccaed68 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:09.686552 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b7add61b-fa61-4ea6-b817-98d79ccaed68 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:09.698135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b7add61b-fa61-4ea6-b817-98d79ccaed68 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:09.698741 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b7add61b-fa61-4ea6-b817-98d79ccaed68 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:09.699519 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b7add61b-fa61-4ea6-b817-98d79ccaed68 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:09.699955 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b7add61b-fa61-4ea6-b817-98d79ccaed68 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:09.834243 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b7add61b-fa61-4ea6-b817-98d79ccaed68 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:09.842023 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b7add61b-fa61-4ea6-b817-98d79ccaed68 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.160062 Jun 30 18:30:09.843063 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 306/633] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:09 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:10.860392 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-cd93fa18-6b13-4bcb-abe6-4fb399c09a11 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:10.860999 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-cd93fa18-6b13-4bcb-abe6-4fb399c09a11 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:10.867694 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cd93fa18-6b13-4bcb-abe6-4fb399c09a11 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:10.868143 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cd93fa18-6b13-4bcb-abe6-4fb399c09a11 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:10.868904 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cd93fa18-6b13-4bcb-abe6-4fb399c09a11 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:10.869340 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-cd93fa18-6b13-4bcb-abe6-4fb399c09a11 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:11.003869 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-cd93fa18-6b13-4bcb-abe6-4fb399c09a11 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:11.012436 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-cd93fa18-6b13-4bcb-abe6-4fb399c09a11 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.156070 Jun 30 18:30:11.013016 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 328/634] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:10 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:12.139038 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ca190749-1605-4f82-affd-e799365fa404 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:12.139827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ca190749-1605-4f82-affd-e799365fa404 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:12.145902 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca190749-1605-4f82-affd-e799365fa404 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:12.146379 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca190749-1605-4f82-affd-e799365fa404 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:12.147169 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca190749-1605-4f82-affd-e799365fa404 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:12.147596 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ca190749-1605-4f82-affd-e799365fa404 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:12.287303 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ca190749-1605-4f82-affd-e799365fa404 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:12.295176 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ca190749-1605-4f82-affd-e799365fa404 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.269274 Jun 30 18:30:12.295745 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 307/635] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:12 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:13.223384 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:13.223893 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:13.230455 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:13.230906 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:13.231659 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:13.232087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:13.236087 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:13.246968 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] HTTP exception thrown: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Request method failure captured: Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: DELETE /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 HTTP/1.1 Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveL6FYylAQA5QUtIGY6-WeYVAJCtRDdyGdWxs5CjnPdannJc0DrRTjLsRDIxYwvU8oBpQLLugl0267HszgIUAgQ1uLB0677WnvU0KU4zCLRTz8p_PpddBX44P7RNaVsmiUu0Ehcgtd57WqIqL4h7WWj2Dm5HEkrtfidLTcAbgNyCWJY Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:30:13.248606 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}] Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 2ed5e98a29c44296aeb921af4f521042 Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.250164 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '3f69cd5f-ec69-4537-8a65-7f5325788f53'} Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:30:13.250979 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.252213 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.253357 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Returning 404 to user: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:30:13.253357 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d05702e7-d7b3-4e80-9361-633ec78b43cd tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 404 len: 111 microversion: 2.1 time: 0.030535 Jun 30 18:30:13.253357 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 329/636] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:30:13 2022] DELETE /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:30:13.258493 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:13.259103 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: 3f69cd5f-ec69-4537-8a65-7f5325788f53] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:13.266928 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:13.267380 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:13.268350 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:13.268791 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:13.283013 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] HTTP exception thrown: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Request method failure captured: Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 HTTP/1.1 Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL6FYylAQA5QUtIGY6-WeYVAJCtRDdyGdWxs5CjnPdannJc0DrRTjLsRDIxYwvU8oBpQLLugl0267HszgIUAgQ1uLB0677WnvU0KU4zCLRTz8p_PpddBX44P7RNaVsmiUu0Ehcgtd57WqIqL4h7WWj2Dm5HEkrtfidLTcAbgNyCWJY Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:30:13.284539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}] Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 2ed5e98a29c44296aeb921af4f521042 Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.286020 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '3f69cd5f-ec69-4537-8a65-7f5325788f53'} Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:30:13.286897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. Jun 30 18:30:13.288245 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:13.290057 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Returning 404 to user: Instance 3f69cd5f-ec69-4537-8a65-7f5325788f53 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:30:13.290057 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-38b6a812-1576-4acd-8b14-68561f3215f5 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53" status: 404 len: 111 microversion: 2.1 time: 0.031310 Jun 30 18:30:13.290057 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 308/637] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:13 2022] GET /compute/v2.1/servers/3f69cd5f-ec69-4537-8a65-7f5325788f53 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:30:13.313261 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-8b20b5c7-2c0f-43da-8f39-150438524daf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:13.313864 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-8b20b5c7-2c0f-43da-8f39-150438524daf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:13.320694 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8b20b5c7-2c0f-43da-8f39-150438524daf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:13.321137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8b20b5c7-2c0f-43da-8f39-150438524daf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:13.321901 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8b20b5c7-2c0f-43da-8f39-150438524daf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:13.322463 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-8b20b5c7-2c0f-43da-8f39-150438524daf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:13.466428 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-8b20b5c7-2c0f-43da-8f39-150438524daf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:13.474169 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-8b20b5c7-2c0f-43da-8f39-150438524daf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.165057 Jun 30 18:30:13.474770 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 330/638] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:13 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:30:13.852749 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-b700b65f-0a19-4266-8e6d-c01141acc9d6 req-372cac65-e5ac-4506-b4b7-4f293f7ec524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513aedba-0675-4c23-a0dc-c081a54704d9", "name": "network-vif-plugged", "status": "completed", "tag": "3d9c8a6c-255b-46d9-828b-11136e25b879"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:30:13.861462 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-b700b65f-0a19-4266-8e6d-c01141acc9d6 req-372cac65-e5ac-4506-b4b7-4f293f7ec524 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:13.862173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-b700b65f-0a19-4266-8e6d-c01141acc9d6 req-372cac65-e5ac-4506-b4b7-4f293f7ec524 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:13.875568 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-b700b65f-0a19-4266-8e6d-c01141acc9d6 req-372cac65-e5ac-4506-b4b7-4f293f7ec524 service nova] Creating event network-vif-plugged:3d9c8a6c-255b-46d9-828b-11136e25b879 for instance 513aedba-0675-4c23-a0dc-c081a54704d9 on hv-cinder-81268 Jun 30 18:30:13.881618 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-b700b65f-0a19-4266-8e6d-c01141acc9d6 req-372cac65-e5ac-4506-b4b7-4f293f7ec524 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033048 Jun 30 18:30:13.882437 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 309/639] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:30:14.433118 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:14.433601 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:14.435518 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=35 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:14.440873 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:14.441314 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:14.442068 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:14.442528 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:14.455998 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] HTTP exception thrown: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Request method failure captured: Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: DELETE /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 HTTP/1.1 Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABiveL6FYylAQA5QUtIGY6-WeYVAJCtRDdyGdWxs5CjnPdannJc0DrRTjLsRDIxYwvU8oBpQLLugl0267HszgIUAgQ1uLB0677WnvU0KU4zCLRTz8p_PpddBX44P7RNaVsmiUu0Ehcgtd57WqIqL4h7WWj2Dm5HEkrtfidLTcAbgNyCWJY Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:30:14.457536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}] Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 2ed5e98a29c44296aeb921af4f521042 Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.459065 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': 'ed940450-c1a0-4aea-9b4b-65d90d495225'} Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:30:14.459914 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.461291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.462789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Returning 404 to user: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:30:14.462789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-832601d1-df03-4646-8589-9102fe904d24 tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 404 len: 111 microversion: 2.1 time: 0.030278 Jun 30 18:30:14.462789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 331/640] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:30:14 2022] DELETE /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 18:30:14.468289 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:14.468982 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] [instance: ed940450-c1a0-4aea-9b4b-65d90d495225] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:14.470913 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=33 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:14.476607 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:14.477055 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:14.477813 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:14.478252 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:14.483658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=89 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:30:14.492447 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-19c2021d-15aa-4aec-b819-19a4ea871342 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:14.493049 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-19c2021d-15aa-4aec-b819-19a4ea871342 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:14.494325 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] HTTP exception thrown: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Request method failure captured: Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 HTTP/1.1 Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveL6FYylAQA5QUtIGY6-WeYVAJCtRDdyGdWxs5CjnPdannJc0DrRTjLsRDIxYwvU8oBpQLLugl0267HszgIUAgQ1uLB0677WnvU0KU4zCLRTz8p_PpddBX44P7RNaVsmiUu0Ehcgtd57WqIqL4h7WWj2Dm5HEkrtfidLTcAbgNyCWJY Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:30:14.495978 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/eacf1ab0e2244313b8f4f04d5d5202fa"}]}] Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: eacf1ab0e2244313b8f4f04d5d5202fa Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1773524185 Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 2ed5e98a29c44296aeb921af4f521042 Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-AttachVolumeNegativeTest-1773524185-project Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.497468 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': 'ed940450-c1a0-4aea-9b4b-65d90d495225'} Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:30:14.498312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. Jun 30 18:30:14.499738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:30:14.501029 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] Returning 404 to user: Instance ed940450-c1a0-4aea-9b4b-65d90d495225 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:30:14.501029 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-48e07861-a2e4-4e54-a992-a167fb6c6f2e tempest-AttachVolumeNegativeTest-1773524185 tempest-AttachVolumeNegativeTest-1773524185-project] 10.222.0.16 "GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225" status: 404 len: 111 microversion: 2.1 time: 0.033665 Jun 30 18:30:14.501029 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 310/641] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:14 2022] GET /compute/v2.1/servers/ed940450-c1a0-4aea-9b4b-65d90d495225 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 18:30:14.501286 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-19c2021d-15aa-4aec-b819-19a4ea871342 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:14.501286 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-19c2021d-15aa-4aec-b819-19a4ea871342 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:14.501286 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-19c2021d-15aa-4aec-b819-19a4ea871342 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:14.501286 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-19c2021d-15aa-4aec-b819-19a4ea871342 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:14.635442 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-19c2021d-15aa-4aec-b819-19a4ea871342 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:14.643197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-19c2021d-15aa-4aec-b819-19a4ea871342 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1573 microversion: 2.1 time: 0.155201 Jun 30 18:30:14.643760 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 332/642] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:14 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:30:15.661330 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-2902ca21-e40a-4a90-9f52-136c4aca45cf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:30:15.661942 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-2902ca21-e40a-4a90-9f52-136c4aca45cf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:30:15.669079 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2902ca21-e40a-4a90-9f52-136c4aca45cf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:15.669526 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2902ca21-e40a-4a90-9f52-136c4aca45cf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:15.670291 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2902ca21-e40a-4a90-9f52-136c4aca45cf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:30:15.670750 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-2902ca21-e40a-4a90-9f52-136c4aca45cf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:30:15.813802 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-2902ca21-e40a-4a90-9f52-136c4aca45cf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:30:15.824690 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-2902ca21-e40a-4a90-9f52-136c4aca45cf tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1560 microversion: 2.1 time: 0.167297 Jun 30 18:30:15.825384 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 311/643] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:30:15 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:31:17.078421 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:31:17.079136 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:31:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:31:19.227376 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:31:19.227948 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:31:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:32:11.221291 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=3 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:11.222278 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=14 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:11.461533 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-db76563e-4085-4636-b069-5d97d80665fc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Action: 'create', calling method: .version_select at 0x7f8f3c2fd940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1800199925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYXcS+k4Tu+xB+sAkdgjm5G7lITSrQfZnrYVsXVfX6rdQ2nXe3iBLVGfvYLMC7QM83hhGKOeVyccaNxzYrQ0AH77463R1UCizlH6/BiAnqAKUevDZLn2fTonGsUeCPsCA=="}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:11.476442 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-db76563e-4085-4636-b069-5d97d80665fc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Getting quotas for project ad915a3e597f4730a63420d59470f5b6. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:32:11.480647 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-db76563e-4085-4636-b069-5d97d80665fc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Getting quotas for user 40078727842f491bb566e205065a65ad and project ad915a3e597f4730a63420d59470f5b6. Resources: {'key_pairs'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:32:11.509410 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-db76563e-4085-4636-b069-5d97d80665fc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.289668 Jun 30 18:32:11.510013 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 333/644] 10.222.0.16 () {60 vars in 1158 bytes} [Thu Jun 30 18:32:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:32:20.426110 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=3 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:20.427434 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=7 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:20.434372 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-c4e4356f-d2e0-40fb-b7cb-35d9e262c08b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:20.434887 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c4e4356f-d2e0-40fb-b7cb-35d9e262c08b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:20.443409 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c4e4356f-d2e0-40fb-b7cb-35d9e262c08b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:20.444538 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c4e4356f-d2e0-40fb-b7cb-35d9e262c08b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:20.445328 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c4e4356f-d2e0-40fb-b7cb-35d9e262c08b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:20.445897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-c4e4356f-d2e0-40fb-b7cb-35d9e262c08b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:20.480779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-c4e4356f-d2e0-40fb-b7cb-35d9e262c08b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:32:20.521072 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-db77fa80-1329-40ad-9b46-142c57f40bd0 req-700bd30c-4ce6-480d-90e8-a94f2f11baec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "513aedba-0675-4c23-a0dc-c081a54704d9", "tag": "3d9c8a6c-255b-46d9-828b-11136e25b879"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:20.538132 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-db77fa80-1329-40ad-9b46-142c57f40bd0 req-700bd30c-4ce6-480d-90e8-a94f2f11baec service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:20.539758 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-db77fa80-1329-40ad-9b46-142c57f40bd0 req-700bd30c-4ce6-480d-90e8-a94f2f11baec service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:20.551045 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-db77fa80-1329-40ad-9b46-142c57f40bd0 req-700bd30c-4ce6-480d-90e8-a94f2f11baec service nova] Creating event network-changed:3d9c8a6c-255b-46d9-828b-11136e25b879 for instance 513aedba-0675-4c23-a0dc-c081a54704d9 on hv-cinder-81268 Jun 30 18:32:20.557242 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-db77fa80-1329-40ad-9b46-142c57f40bd0 req-700bd30c-4ce6-480d-90e8-a94f2f11baec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124379 Jun 30 18:32:20.558090 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 334/645] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:32:20.573690 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-c4e4356f-d2e0-40fb-b7cb-35d9e262c08b tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "DELETE /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 204 len: 0 microversion: 2.1 time: 0.152086 Jun 30 18:32:20.574380 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 312/646] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:32:20 2022] DELETE /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:32:20.586490 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-de4bdce8-8887-49e7-ae1d-6c013985c79f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:20.587178 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-de4bdce8-8887-49e7-ae1d-6c013985c79f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:20.594043 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-de4bdce8-8887-49e7-ae1d-6c013985c79f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:20.595317 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-de4bdce8-8887-49e7-ae1d-6c013985c79f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:20.596102 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-de4bdce8-8887-49e7-ae1d-6c013985c79f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:20.596538 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-de4bdce8-8887-49e7-ae1d-6c013985c79f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:20.900918 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-de4bdce8-8887-49e7-ae1d-6c013985c79f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:20.910293 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-de4bdce8-8887-49e7-ae1d-6c013985c79f tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.328287 Jun 30 18:32:20.910910 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 335/647] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:20 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:21.930505 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7c261df3-91a3-4398-a3fd-2d529fb9ab30 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:21.931444 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7c261df3-91a3-4398-a3fd-2d529fb9ab30 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:21.946679 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7c261df3-91a3-4398-a3fd-2d529fb9ab30 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:21.947131 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7c261df3-91a3-4398-a3fd-2d529fb9ab30 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:21.947926 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7c261df3-91a3-4398-a3fd-2d529fb9ab30 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:21.948364 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7c261df3-91a3-4398-a3fd-2d529fb9ab30 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:22.147039 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7c261df3-91a3-4398-a3fd-2d529fb9ab30 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:22.154660 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7c261df3-91a3-4398-a3fd-2d529fb9ab30 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.228508 Jun 30 18:32:22.155557 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 313/648] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:21 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:23.171532 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=4 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:23.177427 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-5d161793-57ed-492a-bb6a-3995d7eac537 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:23.178088 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-5d161793-57ed-492a-bb6a-3995d7eac537 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:23.185786 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5d161793-57ed-492a-bb6a-3995d7eac537 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:23.186283 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5d161793-57ed-492a-bb6a-3995d7eac537 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:23.187992 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5d161793-57ed-492a-bb6a-3995d7eac537 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:23.188444 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-5d161793-57ed-492a-bb6a-3995d7eac537 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:23.449018 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-5d161793-57ed-492a-bb6a-3995d7eac537 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:23.463159 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-5d161793-57ed-492a-bb6a-3995d7eac537 tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1566 microversion: 2.1 time: 0.292600 Jun 30 18:32:23.465543 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 336/649] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:23 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1566 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:24.196499 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-6539977b-798d-4b0e-9a09-55b4d9d22c59 req-c2aef76c-9bc3-4290-b750-dff2dd3b8b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "513aedba-0675-4c23-a0dc-c081a54704d9", "name": "network-vif-deleted", "tag": "3d9c8a6c-255b-46d9-828b-11136e25b879"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:24.205108 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-6539977b-798d-4b0e-9a09-55b4d9d22c59 req-c2aef76c-9bc3-4290-b750-dff2dd3b8b08 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:24.205549 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-6539977b-798d-4b0e-9a09-55b4d9d22c59 req-c2aef76c-9bc3-4290-b750-dff2dd3b8b08 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.219813 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-6539977b-798d-4b0e-9a09-55b4d9d22c59 req-c2aef76c-9bc3-4290-b750-dff2dd3b8b08 service nova] Creating event network-vif-deleted:3d9c8a6c-255b-46d9-828b-11136e25b879 for instance 513aedba-0675-4c23-a0dc-c081a54704d9 on hv-cinder-81268 Jun 30 18:32:24.224739 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-6539977b-798d-4b0e-9a09-55b4d9d22c59 req-c2aef76c-9bc3-4290-b750-dff2dd3b8b08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112698 Jun 30 18:32:24.225336 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 314/650] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:32:24.481067 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-0fd2f373-415c-4680-9b08-0cfc36aa713a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:24.482050 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-0fd2f373-415c-4680-9b08-0cfc36aa713a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:24.488837 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0fd2f373-415c-4680-9b08-0cfc36aa713a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:24.489274 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0fd2f373-415c-4680-9b08-0cfc36aa713a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.490061 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0fd2f373-415c-4680-9b08-0cfc36aa713a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:24.490535 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0fd2f373-415c-4680-9b08-0cfc36aa713a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:24.558396 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-0fd2f373-415c-4680-9b08-0cfc36aa713a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82765721711e484d8bc87340177657cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a262c7be2bc040eea71787e95b11c92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:24.568633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-0fd2f373-415c-4680-9b08-0cfc36aa713a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 200 len: 1217 microversion: 2.1 time: 0.091342 Jun 30 18:32:24.569217 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 337/651] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:24 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:32:25.587510 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:25.588296 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] [instance: 513aedba-0675-4c23-a0dc-c081a54704d9] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:25.596481 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:25.596935 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:25.597709 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:25.598143 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:25.612548 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] HTTP exception thrown: Instance 513aedba-0675-4c23-a0dc-c081a54704d9 could not be found. Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Request method failure captured: Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 HTTP/1.1 Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABiveqCCwKEml0rNa-GAt9HfIVmmB5TbsO_-kppeb8Bn-EjF1QGcPSIurmpUu8MrAw1zPoOMXDbTbsHXDYt2P5msFHR9dx57L_5r3MTXABYGrfX3gXRsu0vescFCtJI1XFn1kkEO7dCjz4-TUhMskZgYvWjmUIj_USQxK-i9Z5xJ8Lxf3Y Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: a262c7be2bc040eea71787e95b11c92f Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-TestShelveInstance-382535509 Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:32:25.614227 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a262c7be2bc040eea71787e95b11c92f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a262c7be2bc040eea71787e95b11c92f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a262c7be2bc040eea71787e95b11c92f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a262c7be2bc040eea71787e95b11c92f"}]}] Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-TestShelveInstance-382535509 Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: a262c7be2bc040eea71787e95b11c92f Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-TestShelveInstance-382535509 Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-TestShelveInstance-382535509-project Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 82765721711e484d8bc87340177657cc Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-TestShelveInstance-382535509-project Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 513aedba-0675-4c23-a0dc-c081a54704d9 could not be found. Jun 30 18:32:25.615747 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '513aedba-0675-4c23-a0dc-c081a54704d9'} Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 513aedba-0675-4c23-a0dc-c081a54704d9 could not be found. Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:32:25.616704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 513aedba-0675-4c23-a0dc-c081a54704d9 could not be found. Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 513aedba-0675-4c23-a0dc-c081a54704d9 could not be found. Jun 30 18:32:25.618173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:32:25.619491 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Returning 404 to user: Instance 513aedba-0675-4c23-a0dc-c081a54704d9 could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:32:25.619491 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5d2d073f-f537-4089-8acc-0c30cd36c25a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9" status: 404 len: 111 microversion: 2.1 time: 0.034267 Jun 30 18:32:25.619491 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 315/652] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:25 2022] GET /compute/v2.1/servers/513aedba-0675-4c23-a0dc-c081a54704d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:32:25.780536 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-212f4c62-e062-4375-b125-3ace406feb5a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] Calling method '.version_select at 0x7f8f3c2fddc0>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:25.802173 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-212f4c62-e062-4375-b125-3ace406feb5a tempest-TestShelveInstance-382535509 tempest-TestShelveInstance-382535509-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-49126469" status: 202 len: 0 microversion: 2.1 time: 0.025443 Jun 30 18:32:25.802802 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 338/653] 10.222.0.16 () {58 vars in 1247 bytes} [Thu Jun 30 18:32:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-49126469 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:32:40.604829 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1962991211", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1800199925", "security_groups": [{"name": "tempest-secgroup-smoke-308278701"}], "block_device_mapping_v2": [{"uuid": "c07bd70f-6eb4-4028-9565-12ef8f0ba823", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a68d490-179c-4e2d-a881-ed4914af170c"}]}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:40.613886 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:40.614561 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:40.737662 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] validate_networks() for [('2a68d490-179c-4e2d-a881-ed4914af170c', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:32:41.216739 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:32:41.217160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:32:41.217619 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:32:41.218016 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:32:41.218501 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:32:41.228213 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:41.228652 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:41.229428 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:41.229854 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:41.246021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Getting quotas for project ad915a3e597f4730a63420d59470f5b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:32:41.250506 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Getting quotas for user 40078727842f491bb566e205065a65ad and project ad915a3e597f4730a63420d59470f5b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:32:41.311767 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:32:41.314391 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c07bd70f-6eb4-4028-9565-12ef8f0ba823',volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:32:41.438827 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [74bbf2bc-bae9-4fb1-a185-c948f9b6332c] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:32:42.447770 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [74bbf2bc-bae9-4fb1-a185-c948f9b6332c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38474. Jun 30 18:32:42.452168 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-feb59d9e-fc9c-479b-8681-023d1658d0d7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.851346 Jun 30 18:32:42.453377 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 316/654] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:32:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:32:42.460259 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=20 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:42.461470 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:42.465799 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-61b5eb46-1511-4d96-8fa4-238efea18ede tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:42.466427 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-61b5eb46-1511-4d96-8fa4-238efea18ede tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:42.522109 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-61b5eb46-1511-4d96-8fa4-238efea18ede tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:42.528966 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-61b5eb46-1511-4d96-8fa4-238efea18ede tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1095 microversion: 2.1 time: 0.069561 Jun 30 18:32:42.529518 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 339/655] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:42 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:43.547474 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7bdb27f0-11a6-4528-a15a-56c44eb5e449 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:43.548120 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7bdb27f0-11a6-4528-a15a-56c44eb5e449 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:43.600168 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7bdb27f0-11a6-4528-a15a-56c44eb5e449 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:43.607549 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7bdb27f0-11a6-4528-a15a-56c44eb5e449 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1095 microversion: 2.1 time: 0.065178 Jun 30 18:32:43.608123 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 317/656] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:43 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:44.625634 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ec9faab8-207c-43fd-a849-c5d269ec08dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:44.626408 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-ec9faab8-207c-43fd-a849-c5d269ec08dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:44.678877 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-ec9faab8-207c-43fd-a849-c5d269ec08dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:44.685806 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ec9faab8-207c-43fd-a849-c5d269ec08dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1095 microversion: 2.1 time: 0.064826 Jun 30 18:32:44.686726 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 340/657] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:44 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:45.703946 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-52f2cc97-2f25-4d83-847a-42dbaea04e58 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:45.704661 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-52f2cc97-2f25-4d83-847a-42dbaea04e58 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:45.755757 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-52f2cc97-2f25-4d83-847a-42dbaea04e58 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:45.762463 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-52f2cc97-2f25-4d83-847a-42dbaea04e58 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1095 microversion: 2.1 time: 0.063021 Jun 30 18:32:45.763022 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 318/658] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:45 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:46.779181 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-f2bef8a0-5eb0-45c1-ad65-1005bda84e2c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:46.779811 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-f2bef8a0-5eb0-45c1-ad65-1005bda84e2c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:46.785901 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f2bef8a0-5eb0-45c1-ad65-1005bda84e2c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:46.786354 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f2bef8a0-5eb0-45c1-ad65-1005bda84e2c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:46.787128 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f2bef8a0-5eb0-45c1-ad65-1005bda84e2c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:46.787559 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-f2bef8a0-5eb0-45c1-ad65-1005bda84e2c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:46.851375 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-f2bef8a0-5eb0-45c1-ad65-1005bda84e2c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:46.859624 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-f2bef8a0-5eb0-45c1-ad65-1005bda84e2c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1145 microversion: 2.1 time: 0.084296 Jun 30 18:32:46.860188 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 341/659] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:46 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:47.877990 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-67d330c3-10a7-45e4-b9dc-301945dbaab5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:47.878651 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-67d330c3-10a7-45e4-b9dc-301945dbaab5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:47.885311 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-67d330c3-10a7-45e4-b9dc-301945dbaab5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:47.885731 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-67d330c3-10a7-45e4-b9dc-301945dbaab5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:47.886516 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-67d330c3-10a7-45e4-b9dc-301945dbaab5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:47.886947 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-67d330c3-10a7-45e4-b9dc-301945dbaab5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:47.959073 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-67d330c3-10a7-45e4-b9dc-301945dbaab5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:47.971797 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-67d330c3-10a7-45e4-b9dc-301945dbaab5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1211 microversion: 2.1 time: 0.099283 Jun 30 18:32:47.972759 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 319/660] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:47 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:48.994123 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0c0ae57c-bad6-4f95-8568-11485d630eb8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:48.995801 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0c0ae57c-bad6-4f95-8568-11485d630eb8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:48.996556 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-0a375ca2-4f1a-45fe-8a04-859dd48d9feb req-cb384aea-3a53-4015-bd37-3107d816e670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24576f9c-71cf-4537-9f3b-6925dc85953f", "tag": "eb8be3d5-02e0-45dd-ae18-33de2015cf42"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:32:49.017072 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c0ae57c-bad6-4f95-8568-11485d630eb8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:49.017430 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c0ae57c-bad6-4f95-8568-11485d630eb8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:49.019764 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-0a375ca2-4f1a-45fe-8a04-859dd48d9feb req-cb384aea-3a53-4015-bd37-3107d816e670 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:49.020189 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-0a375ca2-4f1a-45fe-8a04-859dd48d9feb req-cb384aea-3a53-4015-bd37-3107d816e670 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:49.025089 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c0ae57c-bad6-4f95-8568-11485d630eb8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:49.025630 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c0ae57c-bad6-4f95-8568-11485d630eb8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:49.052645 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-0a375ca2-4f1a-45fe-8a04-859dd48d9feb req-cb384aea-3a53-4015-bd37-3107d816e670 service nova] Creating event network-changed:eb8be3d5-02e0-45dd-ae18-33de2015cf42 for instance 24576f9c-71cf-4537-9f3b-6925dc85953f on hv-cinder-81268 Jun 30 18:32:49.057993 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-0a375ca2-4f1a-45fe-8a04-859dd48d9feb req-cb384aea-3a53-4015-bd37-3107d816e670 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075170 Jun 30 18:32:49.059180 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 342/661] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:32:49.513101 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0c0ae57c-bad6-4f95-8568-11485d630eb8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:49.521705 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0c0ae57c-bad6-4f95-8568-11485d630eb8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.535021 Jun 30 18:32:49.522429 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 320/662] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:48 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:50.539502 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2815609b-10fe-415a-9a76-d58d4cc395b7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:50.540203 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-2815609b-10fe-415a-9a76-d58d4cc395b7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:50.546746 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2815609b-10fe-415a-9a76-d58d4cc395b7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:50.547193 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2815609b-10fe-415a-9a76-d58d4cc395b7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:50.547952 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2815609b-10fe-415a-9a76-d58d4cc395b7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:50.548382 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2815609b-10fe-415a-9a76-d58d4cc395b7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:50.683562 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2815609b-10fe-415a-9a76-d58d4cc395b7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:50.694667 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2815609b-10fe-415a-9a76-d58d4cc395b7 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.159010 Jun 30 18:32:50.695710 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 343/663] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:50 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:51.712972 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ed4348fe-97dd-4e56-b504-305e6d2a5bbf tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:51.713522 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ed4348fe-97dd-4e56-b504-305e6d2a5bbf tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:51.715763 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:51.722315 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ed4348fe-97dd-4e56-b504-305e6d2a5bbf tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:51.722781 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ed4348fe-97dd-4e56-b504-305e6d2a5bbf tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:51.723548 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ed4348fe-97dd-4e56-b504-305e6d2a5bbf tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:51.723975 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ed4348fe-97dd-4e56-b504-305e6d2a5bbf tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:51.855532 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ed4348fe-97dd-4e56-b504-305e6d2a5bbf tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:51.863771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ed4348fe-97dd-4e56-b504-305e6d2a5bbf tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.154664 Jun 30 18:32:51.864346 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 321/664] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:51 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:52.881094 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-aec5f5f9-d9a6-4ac8-8d50-997b1a75215a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:52.881689 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-aec5f5f9-d9a6-4ac8-8d50-997b1a75215a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:52.887831 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-aec5f5f9-d9a6-4ac8-8d50-997b1a75215a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:52.888267 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-aec5f5f9-d9a6-4ac8-8d50-997b1a75215a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:52.889011 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-aec5f5f9-d9a6-4ac8-8d50-997b1a75215a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:52.889438 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-aec5f5f9-d9a6-4ac8-8d50-997b1a75215a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:53.018619 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-aec5f5f9-d9a6-4ac8-8d50-997b1a75215a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:53.025943 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-aec5f5f9-d9a6-4ac8-8d50-997b1a75215a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.148722 Jun 30 18:32:53.026533 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 344/665] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:52 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:54.042178 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-6cec8dbc-5685-4048-ac72-4eb1a023ba02 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:54.042932 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-6cec8dbc-5685-4048-ac72-4eb1a023ba02 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:54.049640 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6cec8dbc-5685-4048-ac72-4eb1a023ba02 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:54.050087 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6cec8dbc-5685-4048-ac72-4eb1a023ba02 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:54.050872 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6cec8dbc-5685-4048-ac72-4eb1a023ba02 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:54.051309 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-6cec8dbc-5685-4048-ac72-4eb1a023ba02 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:54.183898 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-6cec8dbc-5685-4048-ac72-4eb1a023ba02 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:54.196153 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-6cec8dbc-5685-4048-ac72-4eb1a023ba02 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.157758 Jun 30 18:32:54.196724 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 322/666] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:54 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:55.213003 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-c5a3c156-b3b4-4015-9b65-9f9226c227bd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:55.213651 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-c5a3c156-b3b4-4015-9b65-9f9226c227bd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:55.215956 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=4 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:55.221939 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c5a3c156-b3b4-4015-9b65-9f9226c227bd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:55.222439 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c5a3c156-b3b4-4015-9b65-9f9226c227bd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:55.223197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c5a3c156-b3b4-4015-9b65-9f9226c227bd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:55.223631 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-c5a3c156-b3b4-4015-9b65-9f9226c227bd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:55.354864 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-c5a3c156-b3b4-4015-9b65-9f9226c227bd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:55.362296 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-c5a3c156-b3b4-4015-9b65-9f9226c227bd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.153202 Jun 30 18:32:55.362874 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 345/667] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:55 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:56.379407 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-519c8777-bae3-4f33-ab4c-9323dedec48e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:56.380122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-519c8777-bae3-4f33-ab4c-9323dedec48e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:56.382454 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=10 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:32:56.388313 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-519c8777-bae3-4f33-ab4c-9323dedec48e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:56.388779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-519c8777-bae3-4f33-ab4c-9323dedec48e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:56.389576 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-519c8777-bae3-4f33-ab4c-9323dedec48e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:56.390058 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-519c8777-bae3-4f33-ab4c-9323dedec48e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:56.524174 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-519c8777-bae3-4f33-ab4c-9323dedec48e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:56.531566 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-519c8777-bae3-4f33-ab4c-9323dedec48e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.155985 Jun 30 18:32:56.532119 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 323/668] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:56 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:57.548484 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b027bfa3-9553-4725-b4a1-92cf6de4657a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:57.549094 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b027bfa3-9553-4725-b4a1-92cf6de4657a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:57.555371 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b027bfa3-9553-4725-b4a1-92cf6de4657a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:57.555810 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b027bfa3-9553-4725-b4a1-92cf6de4657a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:57.556558 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b027bfa3-9553-4725-b4a1-92cf6de4657a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:57.556982 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b027bfa3-9553-4725-b4a1-92cf6de4657a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:57.690303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b027bfa3-9553-4725-b4a1-92cf6de4657a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:57.698161 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b027bfa3-9553-4725-b4a1-92cf6de4657a tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.153902 Jun 30 18:32:57.698773 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 346/669] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:57 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:58.715513 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d6cf36b1-7d91-4d34-847d-81467a6bf715 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:58.716121 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d6cf36b1-7d91-4d34-847d-81467a6bf715 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:58.723326 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d6cf36b1-7d91-4d34-847d-81467a6bf715 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:58.723773 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d6cf36b1-7d91-4d34-847d-81467a6bf715 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:58.724544 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d6cf36b1-7d91-4d34-847d-81467a6bf715 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:58.724980 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d6cf36b1-7d91-4d34-847d-81467a6bf715 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:58.862203 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d6cf36b1-7d91-4d34-847d-81467a6bf715 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:32:58.869633 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d6cf36b1-7d91-4d34-847d-81467a6bf715 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.157967 Jun 30 18:32:58.870192 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 324/670] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:58 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:32:59.886267 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-0929a766-8e98-441c-a428-039aba338308 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:32:59.886910 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-0929a766-8e98-441c-a428-039aba338308 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:32:59.892955 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0929a766-8e98-441c-a428-039aba338308 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:59.893398 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0929a766-8e98-441c-a428-039aba338308 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:32:59.894150 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0929a766-8e98-441c-a428-039aba338308 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:32:59.894616 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-0929a766-8e98-441c-a428-039aba338308 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:00.048754 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-0929a766-8e98-441c-a428-039aba338308 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:00.056240 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-0929a766-8e98-441c-a428-039aba338308 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.173802 Jun 30 18:33:00.056804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 347/671] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:32:59 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:33:00.750086 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-fb509164-7aa9-441f-b502-c7921f9df7d1 req-81ca7eb5-90f8-4a27-b286-7cd4d2614048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24576f9c-71cf-4537-9f3b-6925dc85953f", "name": "network-vif-plugged", "status": "completed", "tag": "eb8be3d5-02e0-45dd-ae18-33de2015cf42"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:33:00.758114 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-fb509164-7aa9-441f-b502-c7921f9df7d1 req-81ca7eb5-90f8-4a27-b286-7cd4d2614048 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:00.758592 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-fb509164-7aa9-441f-b502-c7921f9df7d1 req-81ca7eb5-90f8-4a27-b286-7cd4d2614048 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:00.769103 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-fb509164-7aa9-441f-b502-c7921f9df7d1 req-81ca7eb5-90f8-4a27-b286-7cd4d2614048 service nova] Creating event network-vif-plugged:eb8be3d5-02e0-45dd-ae18-33de2015cf42 for instance 24576f9c-71cf-4537-9f3b-6925dc85953f on hv-cinder-81268 Jun 30 18:33:00.774129 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-fb509164-7aa9-441f-b502-c7921f9df7d1 req-81ca7eb5-90f8-4a27-b286-7cd4d2614048 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154566 Jun 30 18:33:00.774818 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 325/672] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:33:01.072965 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-83d5c10f-8d06-4d38-b81c-0240673dcc32 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:01.073576 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-83d5c10f-8d06-4d38-b81c-0240673dcc32 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:01.079665 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-83d5c10f-8d06-4d38-b81c-0240673dcc32 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:01.080104 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-83d5c10f-8d06-4d38-b81c-0240673dcc32 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:01.080857 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-83d5c10f-8d06-4d38-b81c-0240673dcc32 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:01.081289 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-83d5c10f-8d06-4d38-b81c-0240673dcc32 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:01.218003 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-83d5c10f-8d06-4d38-b81c-0240673dcc32 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:01.226157 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-83d5c10f-8d06-4d38-b81c-0240673dcc32 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.156980 Jun 30 18:33:01.226759 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 348/673] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:33:01 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:33:02.245155 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d1862d06-63c1-427a-a5ef-39e9c8189309 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:02.245833 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d1862d06-63c1-427a-a5ef-39e9c8189309 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:02.253078 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d1862d06-63c1-427a-a5ef-39e9c8189309 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:02.253523 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d1862d06-63c1-427a-a5ef-39e9c8189309 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:02.254277 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d1862d06-63c1-427a-a5ef-39e9c8189309 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:02.254809 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d1862d06-63c1-427a-a5ef-39e9c8189309 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:02.385262 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d1862d06-63c1-427a-a5ef-39e9c8189309 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:02.393469 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d1862d06-63c1-427a-a5ef-39e9c8189309 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1266 microversion: 2.1 time: 0.153665 Jun 30 18:33:02.394029 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 326/674] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:33:02 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:33:03.410505 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-38e9380b-5d0b-42d1-92c5-7ab6e58a6c8c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:03.411134 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-38e9380b-5d0b-42d1-92c5-7ab6e58a6c8c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:03.417271 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-38e9380b-5d0b-42d1-92c5-7ab6e58a6c8c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:03.417718 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-38e9380b-5d0b-42d1-92c5-7ab6e58a6c8c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:03.418491 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-38e9380b-5d0b-42d1-92c5-7ab6e58a6c8c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:03.418926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-38e9380b-5d0b-42d1-92c5-7ab6e58a6c8c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:03.548402 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-38e9380b-5d0b-42d1-92c5-7ab6e58a6c8c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:03.556022 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-38e9380b-5d0b-42d1-92c5-7ab6e58a6c8c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1453 microversion: 2.1 time: 0.149386 Jun 30 18:33:03.556589 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 349/675] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:33:03 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:33:03.572339 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-5ffe85a3-1ea9-4fb1-9474-98297dc735d5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:33:03.572952 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-5ffe85a3-1ea9-4fb1-9474-98297dc735d5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:33:03.579374 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5ffe85a3-1ea9-4fb1-9474-98297dc735d5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:03.580410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5ffe85a3-1ea9-4fb1-9474-98297dc735d5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:03.581173 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5ffe85a3-1ea9-4fb1-9474-98297dc735d5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:03.581609 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-5ffe85a3-1ea9-4fb1-9474-98297dc735d5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:03.715527 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-5ffe85a3-1ea9-4fb1-9474-98297dc735d5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:33:03.723617 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-5ffe85a3-1ea9-4fb1-9474-98297dc735d5 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1453 microversion: 2.1 time: 0.155040 Jun 30 18:33:03.724181 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 327/676] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:33:03 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:33:05.391432 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-85dcd9f4-8c58-4ab2-8248-ff208e1bd498 req-e15491f4-8e47-4a9a-9638-2ef39021f451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24576f9c-71cf-4537-9f3b-6925dc85953f", "tag": "eb8be3d5-02e0-45dd-ae18-33de2015cf42"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:33:05.400303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-85dcd9f4-8c58-4ab2-8248-ff208e1bd498 req-e15491f4-8e47-4a9a-9638-2ef39021f451 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:33:05.400733 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-85dcd9f4-8c58-4ab2-8248-ff208e1bd498 req-e15491f4-8e47-4a9a-9638-2ef39021f451 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:33:05.412981 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-85dcd9f4-8c58-4ab2-8248-ff208e1bd498 req-e15491f4-8e47-4a9a-9638-2ef39021f451 service nova] Creating event network-changed:eb8be3d5-02e0-45dd-ae18-33de2015cf42 for instance 24576f9c-71cf-4537-9f3b-6925dc85953f on hv-cinder-81268 Jun 30 18:33:05.418382 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-85dcd9f4-8c58-4ab2-8248-ff208e1bd498 req-e15491f4-8e47-4a9a-9638-2ef39021f451 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030412 Jun 30 18:33:05.418975 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 350/677] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:33:06.312199 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:33:06.312387 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:34:37.086565 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:34:37.087151 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:34:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:35:32.732897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 30 18:35:32.734180 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:32.734710 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=52 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:32.739064 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-29c0c521-56a6-48d7-aa0d-94ee1185f4e6 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:32.739561 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-29c0c521-56a6-48d7-aa0d-94ee1185f4e6 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:32.747033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-29c0c521-56a6-48d7-aa0d-94ee1185f4e6 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:32.747486 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-29c0c521-56a6-48d7-aa0d-94ee1185f4e6 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:32.748265 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-29c0c521-56a6-48d7-aa0d-94ee1185f4e6 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:32.748703 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-29c0c521-56a6-48d7-aa0d-94ee1185f4e6 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:32.775433 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-29c0c521-56a6-48d7-aa0d-94ee1185f4e6 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Going to try to terminate instance {{(pid=129371) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:35:32.854265 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-29c0c521-56a6-48d7-aa0d-94ee1185f4e6 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 204 len: 0 microversion: 2.1 time: 0.123312 Jun 30 18:35:32.854918 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 328/678] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:35:32 2022] DELETE /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:35:32.861456 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=28 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:32.862367 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=52 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:32.867098 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-33288628-8bbd-4afe-83e5-ab962caa668b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:32.867787 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-33288628-8bbd-4afe-83e5-ab962caa668b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:32.875427 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-33288628-8bbd-4afe-83e5-ab962caa668b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:32.875872 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-33288628-8bbd-4afe-83e5-ab962caa668b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:32.876631 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-33288628-8bbd-4afe-83e5-ab962caa668b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:32.877053 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-33288628-8bbd-4afe-83e5-ab962caa668b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:33.023511 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-33288628-8bbd-4afe-83e5-ab962caa668b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:33.032119 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-33288628-8bbd-4afe-83e5-ab962caa668b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1576 microversion: 2.1 time: 0.171884 Jun 30 18:35:33.032607 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 351/679] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:32 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:34.050959 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0fec78a3-8ebe-4a20-ae9d-11bb1965e6a0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:34.051626 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0fec78a3-8ebe-4a20-ae9d-11bb1965e6a0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:34.060381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fec78a3-8ebe-4a20-ae9d-11bb1965e6a0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:34.060829 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fec78a3-8ebe-4a20-ae9d-11bb1965e6a0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:34.061622 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fec78a3-8ebe-4a20-ae9d-11bb1965e6a0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:34.062050 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0fec78a3-8ebe-4a20-ae9d-11bb1965e6a0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:34.067773 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] [d7d497bf-b58a-4d7a-a00f-03c412f09b2b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38602. Jun 30 18:35:34.199776 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-0fec78a3-8ebe-4a20-ae9d-11bb1965e6a0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:34.207991 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0fec78a3-8ebe-4a20-ae9d-11bb1965e6a0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1576 microversion: 2.1 time: 0.162028 Jun 30 18:35:34.208552 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 329/680] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:34 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:35.224890 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-d56b989d-7a8f-49db-a544-9b31d8d3e196 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:35.225499 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-d56b989d-7a8f-49db-a544-9b31d8d3e196 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:35.231668 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d56b989d-7a8f-49db-a544-9b31d8d3e196 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:35.232105 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d56b989d-7a8f-49db-a544-9b31d8d3e196 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:35.232900 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d56b989d-7a8f-49db-a544-9b31d8d3e196 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:35.233877 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-d56b989d-7a8f-49db-a544-9b31d8d3e196 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:35.300037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-d56b989d-7a8f-49db-a544-9b31d8d3e196 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:35.307899 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-d56b989d-7a8f-49db-a544-9b31d8d3e196 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1509 microversion: 2.1 time: 0.086795 Jun 30 18:35:35.308463 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 352/681] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:35 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1509 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:35.543762 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-be27ce16-0fad-4226-88e8-77e504f97bde req-fc8200d1-fe3c-4e8d-b512-f43dd01975bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24576f9c-71cf-4537-9f3b-6925dc85953f", "name": "network-vif-deleted", "tag": "eb8be3d5-02e0-45dd-ae18-33de2015cf42"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:35.553431 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-be27ce16-0fad-4226-88e8-77e504f97bde req-fc8200d1-fe3c-4e8d-b512-f43dd01975bf service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:35.553920 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-be27ce16-0fad-4226-88e8-77e504f97bde req-fc8200d1-fe3c-4e8d-b512-f43dd01975bf service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:35.566756 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-be27ce16-0fad-4226-88e8-77e504f97bde req-fc8200d1-fe3c-4e8d-b512-f43dd01975bf service nova] Creating event network-vif-deleted:eb8be3d5-02e0-45dd-ae18-33de2015cf42 for instance 24576f9c-71cf-4537-9f3b-6925dc85953f on hv-cinder-81268 Jun 30 18:35:35.571571 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-be27ce16-0fad-4226-88e8-77e504f97bde req-fc8200d1-fe3c-4e8d-b512-f43dd01975bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031967 Jun 30 18:35:35.572380 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 330/682] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:35:36.326488 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:36.327181 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:36.333931 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:36.334397 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:36.335658 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:36.336086 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:36.371574 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:36.372014 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:36.372476 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.objects.instance [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lazy-loading 'fault' on Instance uuid 24576f9c-71cf-4537-9f3b-6925dc85953f {{(pid=129370) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 18:35:36.414613 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:36.427390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-b76f33e3-1692-45de-83c7-596b61e44c8b tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 200 len: 1231 microversion: 2.1 time: 0.104777 Jun 30 18:35:36.427973 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 353/683] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:36 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:35:37.445692 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:37.446442 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:37.452814 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:37.453266 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:37.454033 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:37.454568 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:37.468031 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] HTTP exception thrown: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Request method failure captured: Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f HTTP/1.1 Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABivewmOwbwMVVixGnzPy1ORZxF1E6fKLyeNMYeSRsvoo3D_2A9P95OH6JBdOlYPGdxp81kcUDnXCE6BeO05gQBZ6rDWD0EhgyTyS5BHuB6o43HvMjgdefd-KPHKJ1E_uCPNf9XMf5M4ogOL1euDkq1ajN-04Fud9g0tXWSxpNTnzL_v74 Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:35:37.469658 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}] Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 40078727842f491bb566e205065a65ad Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:35:37.473077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '24576f9c-71cf-4537-9f3b-6925dc85953f'} Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:35:37.473884 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:35:37.475109 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:35:37.476163 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Returning 404 to user: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:35:37.476163 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3a2d8b76-a986-42e0-b25f-50992dbfaefd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 404 len: 111 microversion: 2.1 time: 0.030091 Jun 30 18:35:37.476163 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 331/684] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:37 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:35:37.530623 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1014691991", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1800199925", "security_groups": [{"name": "tempest-secgroup-smoke-308278701"}], "block_device_mapping_v2": [{"uuid": "c07bd70f-6eb4-4028-9565-12ef8f0ba823", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a68d490-179c-4e2d-a881-ed4914af170c"}]}} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:37.646610 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.network.neutron [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] validate_networks() for [('2a68d490-179c-4e2d-a881-ed4914af170c', None, None, None, None, None)] {{(pid=129370) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:35:38.065028 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Flavor limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:35:38.065442 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Image limits 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:35:38.065904 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Flavor pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:35:38.066357 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Image pref 0:0:0 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:35:38.066756 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.virt.hardware [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129370) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:35:38.077280 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:38.077733 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:38.078553 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:38.078987 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:38.095891 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Getting quotas for project ad915a3e597f4730a63420d59470f5b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:35:38.099789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.quota [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Getting quotas for user 40078727842f491bb566e205065a65ad and project ad915a3e597f4730a63420d59470f5b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129370) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:35:38.161264 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Going to run 1 instances... {{(pid=129370) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:35:38.163655 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c07bd70f-6eb4-4028-9565-12ef8f0ba823',volume_size=None,volume_type=None)] {{(pid=129370) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:35:38.289700 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3cdb31b2-5a68-431c-9cb7-08cef2a8a5f1 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763470 Jun 30 18:35:38.290390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 354/685] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:35:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 18:35:38.300972 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-47f27eeb-a63a-4d99-862f-a9469c8f8d06 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:38.301574 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-47f27eeb-a63a-4d99-862f-a9469c8f8d06 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:38.355641 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-47f27eeb-a63a-4d99-862f-a9469c8f8d06 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:38.362363 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-47f27eeb-a63a-4d99-862f-a9469c8f8d06 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1095 microversion: 2.1 time: 0.065301 Jun 30 18:35:38.363736 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 332/686] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:38 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:39.382371 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-2d29f0a0-5ae0-4f50-a889-7e31d6272338 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:39.382993 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-2d29f0a0-5ae0-4f50-a889-7e31d6272338 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:39.389183 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2d29f0a0-5ae0-4f50-a889-7e31d6272338 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:39.390240 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2d29f0a0-5ae0-4f50-a889-7e31d6272338 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:39.391012 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2d29f0a0-5ae0-4f50-a889-7e31d6272338 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:39.391445 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-2d29f0a0-5ae0-4f50-a889-7e31d6272338 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:39.457400 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-2d29f0a0-5ae0-4f50-a889-7e31d6272338 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:39.465054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-2d29f0a0-5ae0-4f50-a889-7e31d6272338 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1211 microversion: 2.1 time: 0.088236 Jun 30 18:35:39.465661 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 355/687] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:39 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:40.482376 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4eebb021-0b22-4f3d-b3fe-7606a44c0e0f tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:40.483017 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4eebb021-0b22-4f3d-b3fe-7606a44c0e0f tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:40.491085 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4eebb021-0b22-4f3d-b3fe-7606a44c0e0f tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:40.492053 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4eebb021-0b22-4f3d-b3fe-7606a44c0e0f tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:40.492858 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4eebb021-0b22-4f3d-b3fe-7606a44c0e0f tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:40.493279 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4eebb021-0b22-4f3d-b3fe-7606a44c0e0f tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:40.705726 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4eebb021-0b22-4f3d-b3fe-7606a44c0e0f tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:40.713236 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4eebb021-0b22-4f3d-b3fe-7606a44c0e0f tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.234631 Jun 30 18:35:40.713801 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 333/688] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:40 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:40.754084 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-da5dbf4b-85b1-4a3e-8f6f-ac881b04e6bc req-62cb73a6-9770-4403-9a09-47a6e4ab6f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ce02d9-81ad-4756-b262-ab001b8c39fe", "tag": "f9e024ca-30b9-4304-8bbd-160963181b23"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:40.770436 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-da5dbf4b-85b1-4a3e-8f6f-ac881b04e6bc req-62cb73a6-9770-4403-9a09-47a6e4ab6f5e service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:40.771228 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-da5dbf4b-85b1-4a3e-8f6f-ac881b04e6bc req-62cb73a6-9770-4403-9a09-47a6e4ab6f5e service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:40.784734 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-da5dbf4b-85b1-4a3e-8f6f-ac881b04e6bc req-62cb73a6-9770-4403-9a09-47a6e4ab6f5e service nova] Creating event network-changed:f9e024ca-30b9-4304-8bbd-160963181b23 for instance 02ce02d9-81ad-4756-b262-ab001b8c39fe on hv-cinder-81268 Jun 30 18:35:40.791730 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-da5dbf4b-85b1-4a3e-8f6f-ac881b04e6bc req-62cb73a6-9770-4403-9a09-47a6e4ab6f5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045150 Jun 30 18:35:40.792858 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 356/689] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:35:41.730581 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-581e0268-e5b1-4554-a3bd-a81ad61ba7d4 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:41.731238 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-581e0268-e5b1-4554-a3bd-a81ad61ba7d4 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:41.737734 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-581e0268-e5b1-4554-a3bd-a81ad61ba7d4 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:41.738169 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-581e0268-e5b1-4554-a3bd-a81ad61ba7d4 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:41.738954 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-581e0268-e5b1-4554-a3bd-a81ad61ba7d4 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:41.739386 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-581e0268-e5b1-4554-a3bd-a81ad61ba7d4 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:41.870701 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-581e0268-e5b1-4554-a3bd-a81ad61ba7d4 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:41.878026 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-581e0268-e5b1-4554-a3bd-a81ad61ba7d4 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.151341 Jun 30 18:35:41.878615 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 334/690] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:41 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:42.895852 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-06af457d-ca52-40b5-84a1-f6c5a444c695 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:42.896475 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-06af457d-ca52-40b5-84a1-f6c5a444c695 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:42.902725 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-06af457d-ca52-40b5-84a1-f6c5a444c695 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:42.903166 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-06af457d-ca52-40b5-84a1-f6c5a444c695 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:42.903908 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-06af457d-ca52-40b5-84a1-f6c5a444c695 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:42.904330 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-06af457d-ca52-40b5-84a1-f6c5a444c695 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:43.037140 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-06af457d-ca52-40b5-84a1-f6c5a444c695 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:43.045128 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-06af457d-ca52-40b5-84a1-f6c5a444c695 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.153452 Jun 30 18:35:43.045720 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 357/691] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:42 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:44.061865 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-86316c25-27ec-44c9-b373-d4e289756237 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:44.062480 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-86316c25-27ec-44c9-b373-d4e289756237 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:44.069249 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86316c25-27ec-44c9-b373-d4e289756237 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:44.069700 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86316c25-27ec-44c9-b373-d4e289756237 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:44.070488 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86316c25-27ec-44c9-b373-d4e289756237 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:44.070921 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-86316c25-27ec-44c9-b373-d4e289756237 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:44.205489 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-86316c25-27ec-44c9-b373-d4e289756237 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:44.213542 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-86316c25-27ec-44c9-b373-d4e289756237 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.155421 Jun 30 18:35:44.214133 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 335/692] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:44 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:45.231250 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-782eec2c-dbc9-499b-ac4f-de7bb0b20b73 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:45.231810 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-782eec2c-dbc9-499b-ac4f-de7bb0b20b73 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:45.238598 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-782eec2c-dbc9-499b-ac4f-de7bb0b20b73 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:45.239040 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-782eec2c-dbc9-499b-ac4f-de7bb0b20b73 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:45.239804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-782eec2c-dbc9-499b-ac4f-de7bb0b20b73 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:45.240236 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-782eec2c-dbc9-499b-ac4f-de7bb0b20b73 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:45.371334 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-782eec2c-dbc9-499b-ac4f-de7bb0b20b73 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:45.378676 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-782eec2c-dbc9-499b-ac4f-de7bb0b20b73 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.151395 Jun 30 18:35:45.379240 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 358/693] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:45 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:46.395083 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-dce05f15-8ffa-42c4-aae8-e62d853873ab tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:46.395689 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-dce05f15-8ffa-42c4-aae8-e62d853873ab tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:46.402176 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dce05f15-8ffa-42c4-aae8-e62d853873ab tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:46.402655 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dce05f15-8ffa-42c4-aae8-e62d853873ab tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:46.403421 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dce05f15-8ffa-42c4-aae8-e62d853873ab tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:46.403850 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dce05f15-8ffa-42c4-aae8-e62d853873ab tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:46.543718 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-dce05f15-8ffa-42c4-aae8-e62d853873ab tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:46.551820 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-dce05f15-8ffa-42c4-aae8-e62d853873ab tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.160538 Jun 30 18:35:46.552381 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 336/694] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:46 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:47.568715 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-acba1df1-63f1-4242-8097-c314fec9c3cb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:47.569382 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-acba1df1-63f1-4242-8097-c314fec9c3cb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:47.575347 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-acba1df1-63f1-4242-8097-c314fec9c3cb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:47.575689 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-acba1df1-63f1-4242-8097-c314fec9c3cb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:47.577129 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-acba1df1-63f1-4242-8097-c314fec9c3cb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:47.577562 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-acba1df1-63f1-4242-8097-c314fec9c3cb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:47.708228 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-acba1df1-63f1-4242-8097-c314fec9c3cb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:47.715665 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-acba1df1-63f1-4242-8097-c314fec9c3cb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.150955 Jun 30 18:35:47.716227 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 359/695] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:47 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:48.733159 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b0afe7a3-48e9-46fb-9244-07fc9a5e1375 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:48.733768 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b0afe7a3-48e9-46fb-9244-07fc9a5e1375 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:48.736165 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:48.741856 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b0afe7a3-48e9-46fb-9244-07fc9a5e1375 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:48.742310 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b0afe7a3-48e9-46fb-9244-07fc9a5e1375 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:48.743376 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b0afe7a3-48e9-46fb-9244-07fc9a5e1375 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:48.743807 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b0afe7a3-48e9-46fb-9244-07fc9a5e1375 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:48.878731 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b0afe7a3-48e9-46fb-9244-07fc9a5e1375 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:48.886223 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b0afe7a3-48e9-46fb-9244-07fc9a5e1375 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.157557 Jun 30 18:35:48.886815 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 337/696] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:48 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:49.902309 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-fd352e8e-f9d4-4832-ac91-f86dcd69f03e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:49.902945 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-fd352e8e-f9d4-4832-ac91-f86dcd69f03e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:49.905417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=2 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:49.906081 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=6 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:35:49.912241 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fd352e8e-f9d4-4832-ac91-f86dcd69f03e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:49.912693 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fd352e8e-f9d4-4832-ac91-f86dcd69f03e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:49.913458 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fd352e8e-f9d4-4832-ac91-f86dcd69f03e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:49.913895 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fd352e8e-f9d4-4832-ac91-f86dcd69f03e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:50.054627 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-fd352e8e-f9d4-4832-ac91-f86dcd69f03e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:50.062249 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-fd352e8e-f9d4-4832-ac91-f86dcd69f03e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.163689 Jun 30 18:35:50.062924 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 360/697] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:49 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:51.079778 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-4a4b1555-c465-47ed-9bb3-741180d9167d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:51.080329 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-4a4b1555-c465-47ed-9bb3-741180d9167d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:51.086838 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4a4b1555-c465-47ed-9bb3-741180d9167d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:51.087281 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4a4b1555-c465-47ed-9bb3-741180d9167d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:51.088039 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4a4b1555-c465-47ed-9bb3-741180d9167d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:51.088467 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-4a4b1555-c465-47ed-9bb3-741180d9167d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:51.220752 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-4a4b1555-c465-47ed-9bb3-741180d9167d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:51.228218 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-4a4b1555-c465-47ed-9bb3-741180d9167d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.152986 Jun 30 18:35:51.228774 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 338/698] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:51 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:51.521172 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-80b99fc3-df53-459d-9a8d-efb4e8b907ff req-859ce039-6dd6-4695-a2a5-8832ebbcb45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ce02d9-81ad-4756-b262-ab001b8c39fe", "name": "network-vif-plugged", "status": "completed", "tag": "f9e024ca-30b9-4304-8bbd-160963181b23"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:51.530320 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-80b99fc3-df53-459d-9a8d-efb4e8b907ff req-859ce039-6dd6-4695-a2a5-8832ebbcb45b service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:51.530787 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-80b99fc3-df53-459d-9a8d-efb4e8b907ff req-859ce039-6dd6-4695-a2a5-8832ebbcb45b service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:51.543656 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-80b99fc3-df53-459d-9a8d-efb4e8b907ff req-859ce039-6dd6-4695-a2a5-8832ebbcb45b service nova] Creating event network-vif-plugged:f9e024ca-30b9-4304-8bbd-160963181b23 for instance 02ce02d9-81ad-4756-b262-ab001b8c39fe on hv-cinder-81268 Jun 30 18:35:51.549856 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-80b99fc3-df53-459d-9a8d-efb4e8b907ff req-859ce039-6dd6-4695-a2a5-8832ebbcb45b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032639 Jun 30 18:35:51.550561 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 361/699] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:35:52.244197 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-7e3250bf-b91b-4151-80dc-d04a2542017c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:52.244859 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-7e3250bf-b91b-4151-80dc-d04a2542017c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:52.251319 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7e3250bf-b91b-4151-80dc-d04a2542017c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:52.251761 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7e3250bf-b91b-4151-80dc-d04a2542017c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:52.252505 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7e3250bf-b91b-4151-80dc-d04a2542017c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:52.252929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-7e3250bf-b91b-4151-80dc-d04a2542017c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:52.392662 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-7e3250bf-b91b-4151-80dc-d04a2542017c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:52.400500 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-7e3250bf-b91b-4151-80dc-d04a2542017c tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1266 microversion: 2.1 time: 0.160058 Jun 30 18:35:52.401101 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 339/700] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:52 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:53.418414 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-3f78fc41-d381-44e7-81da-e8c081197199 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:53.419167 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-3f78fc41-d381-44e7-81da-e8c081197199 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:53.426493 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3f78fc41-d381-44e7-81da-e8c081197199 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:53.426999 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3f78fc41-d381-44e7-81da-e8c081197199 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:53.427805 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3f78fc41-d381-44e7-81da-e8c081197199 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:53.428288 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-3f78fc41-d381-44e7-81da-e8c081197199 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:53.572668 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-3f78fc41-d381-44e7-81da-e8c081197199 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:53.580701 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-3f78fc41-d381-44e7-81da-e8c081197199 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1452 microversion: 2.1 time: 0.166786 Jun 30 18:35:53.581329 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 362/701] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:53 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:53.602738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-cb486be8-ba80-419b-abfc-2ef20b783728 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:35:53.603731 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-cb486be8-ba80-419b-abfc-2ef20b783728 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:35:53.612664 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-cb486be8-ba80-419b-abfc-2ef20b783728 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:53.613185 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-cb486be8-ba80-419b-abfc-2ef20b783728 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:53.614095 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-cb486be8-ba80-419b-abfc-2ef20b783728 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:53.614680 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-cb486be8-ba80-419b-abfc-2ef20b783728 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:53.777881 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-cb486be8-ba80-419b-abfc-2ef20b783728 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:35:53.786600 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-cb486be8-ba80-419b-abfc-2ef20b783728 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1452 microversion: 2.1 time: 0.187933 Jun 30 18:35:53.787176 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 340/702] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:35:53 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:35:56.026851 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-af998a1a-471a-4691-9312-0f51809384ef req-c3a44929-f756-4e54-8516-5697d36a435d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ce02d9-81ad-4756-b262-ab001b8c39fe", "tag": "f9e024ca-30b9-4304-8bbd-160963181b23"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:35:56.036118 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-af998a1a-471a-4691-9312-0f51809384ef req-c3a44929-f756-4e54-8516-5697d36a435d service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:35:56.036633 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-af998a1a-471a-4691-9312-0f51809384ef req-c3a44929-f756-4e54-8516-5697d36a435d service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:35:56.052009 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-af998a1a-471a-4691-9312-0f51809384ef req-c3a44929-f756-4e54-8516-5697d36a435d service nova] Creating event network-changed:f9e024ca-30b9-4304-8bbd-160963181b23 for instance 02ce02d9-81ad-4756-b262-ab001b8c39fe on hv-cinder-81268 Jun 30 18:35:56.058804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-af998a1a-471a-4691-9312-0f51809384ef req-c3a44929-f756-4e54-8516-5697d36a435d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036292 Jun 30 18:35:56.059819 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 363/703] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:37:57.095282 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:37:57.096079 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:37:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:37:59.240018 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:37:59.240654 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:37:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:37:59.572282 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:59.573040 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:37:59.577837 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-232761789", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1800199925", "security_groups": [{"name": "tempest-secgroup-smoke-308278701"}], "block_device_mapping_v2": [{"uuid": "1f87f894-42eb-49a7-b4da-a233c5af44e5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a68d490-179c-4e2d-a881-ed4914af170c"}]}} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:37:59.777574 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.network.neutron [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] validate_networks() for [('2a68d490-179c-4e2d-a881-ed4914af170c', None, None, None, None, None)] {{(pid=129371) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 18:38:00.270180 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Flavor limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 18:38:00.270712 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Image limits 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 18:38:00.271183 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Flavor pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 18:38:00.271593 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Image pref 0:0:0 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 18:38:00.272000 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.virt.hardware [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129371) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 18:38:00.282671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:00.283112 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:00.283958 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:00.284344 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:00.305161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Getting quotas for project ad915a3e597f4730a63420d59470f5b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 18:38:00.310146 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.quota [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Getting quotas for user 40078727842f491bb566e205065a65ad and project ad915a3e597f4730a63420d59470f5b6. Resources: {'ram', 'cores', 'instances'} {{(pid=129371) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 18:38:00.382114 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Going to run 1 instances... {{(pid=129371) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 18:38:00.384332 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f87f894-42eb-49a7-b4da-a233c5af44e5',volume_size=None,volume_type=None)] {{(pid=129371) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 18:38:00.565720 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [74bbf2bc-bae9-4fb1-a185-c948f9b6332c] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:38:01.576268 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [74bbf2bc-bae9-4fb1-a185-c948f9b6332c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38776. Jun 30 18:38:01.581092 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-0c885a0e-70a4-414f-bf8f-ede277bd87ef tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.010417 Jun 30 18:38:01.581872 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 341/704] 10.222.0.16 () {60 vars in 1146 bytes} [Thu Jun 30 18:37:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 18:38:01.590689 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:01.592877 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=64 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:01.599044 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-02d243ed-de6c-4ce8-b52a-75c54208c09d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:01.600790 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-02d243ed-de6c-4ce8-b52a-75c54208c09d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:01.726176 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-02d243ed-de6c-4ce8-b52a-75c54208c09d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:01.737872 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-02d243ed-de6c-4ce8-b52a-75c54208c09d tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1094 microversion: 2.1 time: 0.148779 Jun 30 18:38:01.738974 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 364/705] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:01 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1094 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:02.756354 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-aece61fa-4e61-4a61-bd05-691ab68a9114 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:02.757042 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-aece61fa-4e61-4a61-bd05-691ab68a9114 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:02.813126 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-aece61fa-4e61-4a61-bd05-691ab68a9114 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:02.823467 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-aece61fa-4e61-4a61-bd05-691ab68a9114 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1094 microversion: 2.1 time: 0.071398 Jun 30 18:38:02.824207 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 342/706] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:02 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:03.842732 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-43aeef08-f1ad-465a-b093-728a566375fb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:03.843797 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-43aeef08-f1ad-465a-b093-728a566375fb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:03.901095 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-43aeef08-f1ad-465a-b093-728a566375fb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:03.909075 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-43aeef08-f1ad-465a-b093-728a566375fb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1094 microversion: 2.1 time: 0.071689 Jun 30 18:38:03.909692 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 365/707] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:03 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:38:04.932177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-037a4210-d39f-4670-8bc9-d84520726d82 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:04.933287 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-037a4210-d39f-4670-8bc9-d84520726d82 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:05.021715 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-037a4210-d39f-4670-8bc9-d84520726d82 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:05.032497 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-037a4210-d39f-4670-8bc9-d84520726d82 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1094 microversion: 2.1 time: 0.108107 Jun 30 18:38:05.033082 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 343/708] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:04 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:06.057068 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-e8a573db-56a2-4ca1-bea7-30035d7ce905 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:06.057676 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-e8a573db-56a2-4ca1-bea7-30035d7ce905 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:06.067507 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e8a573db-56a2-4ca1-bea7-30035d7ce905 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:06.068304 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e8a573db-56a2-4ca1-bea7-30035d7ce905 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:06.069766 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e8a573db-56a2-4ca1-bea7-30035d7ce905 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:06.070554 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-e8a573db-56a2-4ca1-bea7-30035d7ce905 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:06.161067 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-e8a573db-56a2-4ca1-bea7-30035d7ce905 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:06.172689 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-e8a573db-56a2-4ca1-bea7-30035d7ce905 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1144 microversion: 2.1 time: 0.119380 Jun 30 18:38:06.173283 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 366/709] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:06 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1144 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:06.322833 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:38:06.323114 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:38:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:38:07.194525 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b5cdd3e2-8798-4b27-9dec-66d5dafdd284 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:07.195177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b5cdd3e2-8798-4b27-9dec-66d5dafdd284 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:07.206457 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b5cdd3e2-8798-4b27-9dec-66d5dafdd284 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:07.206941 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b5cdd3e2-8798-4b27-9dec-66d5dafdd284 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:07.207929 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b5cdd3e2-8798-4b27-9dec-66d5dafdd284 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:07.208378 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b5cdd3e2-8798-4b27-9dec-66d5dafdd284 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:07.297619 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b5cdd3e2-8798-4b27-9dec-66d5dafdd284 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:07.311915 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b5cdd3e2-8798-4b27-9dec-66d5dafdd284 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1210 microversion: 2.1 time: 0.120849 Jun 30 18:38:07.313107 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 344/710] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:07 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:08.333761 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-51ba8c91-4919-4c39-8b40-3333c27e66dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:08.334415 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-51ba8c91-4919-4c39-8b40-3333c27e66dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:08.341000 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-51ba8c91-4919-4c39-8b40-3333c27e66dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:08.341456 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-51ba8c91-4919-4c39-8b40-3333c27e66dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:08.342802 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-51ba8c91-4919-4c39-8b40-3333c27e66dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:08.343243 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-51ba8c91-4919-4c39-8b40-3333c27e66dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:08.506908 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-51ba8c91-4919-4c39-8b40-3333c27e66dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:08.521464 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-51ba8c91-4919-4c39-8b40-3333c27e66dd tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.191614 Jun 30 18:38:08.522050 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 367/711] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:08 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:08.955488 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-55630f14-e70d-455d-8bde-75e70bf80c90 req-4bcc864f-87c4-48c0-a577-e14f12aeb3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97b65f6-e562-4206-ab12-768190a95c8e", "tag": "ef2fe3d1-ea07-489f-a271-7e4b5028cb3d"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:08.973166 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-55630f14-e70d-455d-8bde-75e70bf80c90 req-4bcc864f-87c4-48c0-a577-e14f12aeb3e0 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:08.974081 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-55630f14-e70d-455d-8bde-75e70bf80c90 req-4bcc864f-87c4-48c0-a577-e14f12aeb3e0 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:08.990247 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-55630f14-e70d-455d-8bde-75e70bf80c90 req-4bcc864f-87c4-48c0-a577-e14f12aeb3e0 service nova] Creating event network-changed:ef2fe3d1-ea07-489f-a271-7e4b5028cb3d for instance c97b65f6-e562-4206-ab12-768190a95c8e on hv-cinder-81268 Jun 30 18:38:08.994399 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR oslo.messaging._drivers.impl_rabbit [req-55630f14-e70d-455d-8bde-75e70bf80c90 req-4bcc864f-87c4-48c0-a577-e14f12aeb3e0 service nova] [25ea317b-187f-423d-a352-e28696903890] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 18:38:09.542259 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-14f2c0a9-ec20-4fb2-bf65-1850a8583c99 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:09.542973 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-14f2c0a9-ec20-4fb2-bf65-1850a8583c99 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:09.550318 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-14f2c0a9-ec20-4fb2-bf65-1850a8583c99 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:09.550804 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-14f2c0a9-ec20-4fb2-bf65-1850a8583c99 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:09.551586 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-14f2c0a9-ec20-4fb2-bf65-1850a8583c99 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:09.552016 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-14f2c0a9-ec20-4fb2-bf65-1850a8583c99 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:09.698425 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-14f2c0a9-ec20-4fb2-bf65-1850a8583c99 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:09.706490 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-14f2c0a9-ec20-4fb2-bf65-1850a8583c99 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.168135 Jun 30 18:38:09.707076 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 368/712] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:09 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:38:10.005749 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [req-55630f14-e70d-455d-8bde-75e70bf80c90 req-4bcc864f-87c4-48c0-a577-e14f12aeb3e0 service nova] [25ea317b-187f-423d-a352-e28696903890] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38834. Jun 30 18:38:10.010525 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-55630f14-e70d-455d-8bde-75e70bf80c90 req-4bcc864f-87c4-48c0-a577-e14f12aeb3e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.193327 Jun 30 18:38:10.011147 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 345/713] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:38:10.726245 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-fa2f5abe-31b1-4158-8c5e-70b2daeb2cad tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:10.727422 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-fa2f5abe-31b1-4158-8c5e-70b2daeb2cad tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:10.736889 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fa2f5abe-31b1-4158-8c5e-70b2daeb2cad tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:10.737378 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fa2f5abe-31b1-4158-8c5e-70b2daeb2cad tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:10.738532 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fa2f5abe-31b1-4158-8c5e-70b2daeb2cad tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:10.739149 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-fa2f5abe-31b1-4158-8c5e-70b2daeb2cad tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:10.916238 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-fa2f5abe-31b1-4158-8c5e-70b2daeb2cad tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:10.926517 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-fa2f5abe-31b1-4158-8c5e-70b2daeb2cad tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.205871 Jun 30 18:38:10.927685 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 369/714] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:10 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:11.942051 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=2 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:11.948048 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b44ded7c-d339-473e-a740-0bf4b1f4bbaa tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:11.948835 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b44ded7c-d339-473e-a740-0bf4b1f4bbaa tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:11.956955 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b44ded7c-d339-473e-a740-0bf4b1f4bbaa tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:11.957408 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b44ded7c-d339-473e-a740-0bf4b1f4bbaa tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:11.958216 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b44ded7c-d339-473e-a740-0bf4b1f4bbaa tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:11.958685 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b44ded7c-d339-473e-a740-0bf4b1f4bbaa tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:12.109537 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-b44ded7c-d339-473e-a740-0bf4b1f4bbaa tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:12.118103 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b44ded7c-d339-473e-a740-0bf4b1f4bbaa tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.176974 Jun 30 18:38:12.118762 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 346/715] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:11 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:13.135581 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-961b4e83-4149-404d-90dd-5ad17a1a9974 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:13.136219 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-961b4e83-4149-404d-90dd-5ad17a1a9974 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:13.142838 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-961b4e83-4149-404d-90dd-5ad17a1a9974 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:13.143284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-961b4e83-4149-404d-90dd-5ad17a1a9974 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:13.144054 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-961b4e83-4149-404d-90dd-5ad17a1a9974 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:13.144485 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-961b4e83-4149-404d-90dd-5ad17a1a9974 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:13.302758 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-961b4e83-4149-404d-90dd-5ad17a1a9974 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:13.311145 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-961b4e83-4149-404d-90dd-5ad17a1a9974 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.179585 Jun 30 18:38:13.311738 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 370/716] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:13 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:14.329062 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-d21a2def-db27-4f3f-bdd0-69968beba4ba tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:14.329731 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-d21a2def-db27-4f3f-bdd0-69968beba4ba tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:14.337818 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d21a2def-db27-4f3f-bdd0-69968beba4ba tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:14.338281 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d21a2def-db27-4f3f-bdd0-69968beba4ba tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:14.339202 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d21a2def-db27-4f3f-bdd0-69968beba4ba tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:14.339646 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-d21a2def-db27-4f3f-bdd0-69968beba4ba tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:14.513199 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-d21a2def-db27-4f3f-bdd0-69968beba4ba tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:14.522681 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-d21a2def-db27-4f3f-bdd0-69968beba4ba tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.198373 Jun 30 18:38:14.523434 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 347/717] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:14 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:15.541460 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-6e58e7a4-e540-483b-9db9-4aa8d0a7b282 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:15.542130 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-6e58e7a4-e540-483b-9db9-4aa8d0a7b282 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:15.544165 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell0:SELECT=4 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:15.551125 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6e58e7a4-e540-483b-9db9-4aa8d0a7b282 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:15.551576 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6e58e7a4-e540-483b-9db9-4aa8d0a7b282 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:15.552364 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6e58e7a4-e540-483b-9db9-4aa8d0a7b282 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:15.552801 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-6e58e7a4-e540-483b-9db9-4aa8d0a7b282 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:15.708278 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-6e58e7a4-e540-483b-9db9-4aa8d0a7b282 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:15.721575 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-6e58e7a4-e540-483b-9db9-4aa8d0a7b282 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.183718 Jun 30 18:38:15.722702 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 371/718] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:15 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:38:16.744350 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3d0fc758-7ca0-4981-a6f4-50e87b7922eb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:16.745650 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3d0fc758-7ca0-4981-a6f4-50e87b7922eb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:16.749174 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell0:SELECT=10 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:38:16.757101 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3d0fc758-7ca0-4981-a6f4-50e87b7922eb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:16.757683 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3d0fc758-7ca0-4981-a6f4-50e87b7922eb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:16.758560 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3d0fc758-7ca0-4981-a6f4-50e87b7922eb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:16.759034 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3d0fc758-7ca0-4981-a6f4-50e87b7922eb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:16.908518 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3d0fc758-7ca0-4981-a6f4-50e87b7922eb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:16.916737 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3d0fc758-7ca0-4981-a6f4-50e87b7922eb tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.179273 Jun 30 18:38:16.917389 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 348/719] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:16 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:17.935237 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-7e2197f0-6f9f-4be3-959d-da16e354a856 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:17.935926 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-7e2197f0-6f9f-4be3-959d-da16e354a856 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:17.943044 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7e2197f0-6f9f-4be3-959d-da16e354a856 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:17.943496 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7e2197f0-6f9f-4be3-959d-da16e354a856 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:17.944284 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7e2197f0-6f9f-4be3-959d-da16e354a856 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:17.944717 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-7e2197f0-6f9f-4be3-959d-da16e354a856 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:18.108901 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-7e2197f0-6f9f-4be3-959d-da16e354a856 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:18.118406 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-7e2197f0-6f9f-4be3-959d-da16e354a856 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.187008 Jun 30 18:38:18.119430 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 372/720] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:17 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:19.137405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-ab4627ab-4aee-4f4c-b3e8-95e0b1fa5a48 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:19.138056 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-ab4627ab-4aee-4f4c-b3e8-95e0b1fa5a48 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:19.146028 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ab4627ab-4aee-4f4c-b3e8-95e0b1fa5a48 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:19.146530 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ab4627ab-4aee-4f4c-b3e8-95e0b1fa5a48 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:19.147312 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ab4627ab-4aee-4f4c-b3e8-95e0b1fa5a48 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:19.147745 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-ab4627ab-4aee-4f4c-b3e8-95e0b1fa5a48 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:19.300343 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-ab4627ab-4aee-4f4c-b3e8-95e0b1fa5a48 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:19.308539 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-ab4627ab-4aee-4f4c-b3e8-95e0b1fa5a48 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.175045 Jun 30 18:38:19.309124 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 349/721] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:19 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:20.318263 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-0f17f920-03c9-4129-ab74-f0af8e174b03 req-ae735e9e-e906-48ac-b807-135240a0bcdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97b65f6-e562-4206-ab12-768190a95c8e", "name": "network-vif-plugged", "status": "completed", "tag": "ef2fe3d1-ea07-489f-a271-7e4b5028cb3d"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:20.330410 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-dd88544b-2409-4d39-ae46-49174a531aed tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:20.331228 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-0f17f920-03c9-4129-ab74-f0af8e174b03 req-ae735e9e-e906-48ac-b807-135240a0bcdb service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:20.331228 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-0f17f920-03c9-4129-ab74-f0af8e174b03 req-ae735e9e-e906-48ac-b807-135240a0bcdb service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:20.331534 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-dd88544b-2409-4d39-ae46-49174a531aed tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:20.345402 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dd88544b-2409-4d39-ae46-49174a531aed tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:20.345402 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dd88544b-2409-4d39-ae46-49174a531aed tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:20.345402 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dd88544b-2409-4d39-ae46-49174a531aed tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:20.345402 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-dd88544b-2409-4d39-ae46-49174a531aed tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:20.362458 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-0f17f920-03c9-4129-ab74-f0af8e174b03 req-ae735e9e-e906-48ac-b807-135240a0bcdb service nova] Creating event network-vif-plugged:ef2fe3d1-ea07-489f-a271-7e4b5028cb3d for instance c97b65f6-e562-4206-ab12-768190a95c8e on hv-cinder-81268 Jun 30 18:38:20.371789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-0f17f920-03c9-4129-ab74-f0af8e174b03 req-ae735e9e-e906-48ac-b807-135240a0bcdb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137194 Jun 30 18:38:20.372854 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 373/722] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 18:38:20.523494 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-dd88544b-2409-4d39-ae46-49174a531aed tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:20.538989 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-dd88544b-2409-4d39-ae46-49174a531aed tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.216097 Jun 30 18:38:20.540067 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 350/723] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:20 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:38:21.561237 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4aacdd0c-0d45-4359-b6c6-0ce94ec4a922 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:21.562414 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4aacdd0c-0d45-4359-b6c6-0ce94ec4a922 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:21.572008 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4aacdd0c-0d45-4359-b6c6-0ce94ec4a922 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:21.572487 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4aacdd0c-0d45-4359-b6c6-0ce94ec4a922 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:21.573313 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4aacdd0c-0d45-4359-b6c6-0ce94ec4a922 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:21.573752 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4aacdd0c-0d45-4359-b6c6-0ce94ec4a922 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:21.722697 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4aacdd0c-0d45-4359-b6c6-0ce94ec4a922 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:21.731132 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4aacdd0c-0d45-4359-b6c6-0ce94ec4a922 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1265 microversion: 2.1 time: 0.174925 Jun 30 18:38:21.731710 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 374/724] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:21 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:38:22.749165 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-538cc328-60a2-4d2d-a839-4b380101f8a3 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:22.749919 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-538cc328-60a2-4d2d-a839-4b380101f8a3 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:22.757447 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-538cc328-60a2-4d2d-a839-4b380101f8a3 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:22.757895 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-538cc328-60a2-4d2d-a839-4b380101f8a3 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:22.758703 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-538cc328-60a2-4d2d-a839-4b380101f8a3 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:22.759160 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-538cc328-60a2-4d2d-a839-4b380101f8a3 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:22.913705 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-538cc328-60a2-4d2d-a839-4b380101f8a3 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:22.923070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-538cc328-60a2-4d2d-a839-4b380101f8a3 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1451 microversion: 2.1 time: 0.178249 Jun 30 18:38:22.923666 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 351/725] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:22 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:38:22.943036 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-4119a2de-6bd3-46ea-8629-b913ff116028 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:38:22.944239 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-4119a2de-6bd3-46ea-8629-b913ff116028 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:38:22.955390 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4119a2de-6bd3-46ea-8629-b913ff116028 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:22.956354 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4119a2de-6bd3-46ea-8629-b913ff116028 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:22.957951 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4119a2de-6bd3-46ea-8629-b913ff116028 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:22.958849 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-4119a2de-6bd3-46ea-8629-b913ff116028 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:23.133137 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-4119a2de-6bd3-46ea-8629-b913ff116028 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:38:23.141948 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-4119a2de-6bd3-46ea-8629-b913ff116028 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1451 microversion: 2.1 time: 0.206187 Jun 30 18:38:23.142572 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 375/726] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:38:22 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1451 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:38:25.110786 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-0f21053a-5e01-46e6-9304-6125db2361fe req-049d694d-b423-4815-ab5f-aeeaaf1f71f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97b65f6-e562-4206-ab12-768190a95c8e", "tag": "ef2fe3d1-ea07-489f-a271-7e4b5028cb3d"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:38:25.119923 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-0f21053a-5e01-46e6-9304-6125db2361fe req-049d694d-b423-4815-ab5f-aeeaaf1f71f9 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:38:25.120376 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-0f21053a-5e01-46e6-9304-6125db2361fe req-049d694d-b423-4815-ab5f-aeeaaf1f71f9 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:38:25.142057 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-0f21053a-5e01-46e6-9304-6125db2361fe req-049d694d-b423-4815-ab5f-aeeaaf1f71f9 service nova] Creating event network-changed:ef2fe3d1-ea07-489f-a271-7e4b5028cb3d for instance c97b65f6-e562-4206-ab12-768190a95c8e on hv-cinder-81268 Jun 30 18:38:25.151911 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-0f21053a-5e01-46e6-9304-6125db2361fe req-049d694d-b423-4815-ab5f-aeeaaf1f71f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113515 Jun 30 18:38:25.153322 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 352/727] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:15.530912 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_api:SELECT=28 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:15.531858 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG dbcounter [-] [129370] Writing DB stats nova_cell1:SELECT=56 {{(pid=129370) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:15.539771 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:15.540592 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG dbcounter [-] [129371] Writing DB stats nova_cell1:SELECT=48 {{(pid=129371) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 18:40:15.544722 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-00372f47-a144-4977-9e3d-d80d46989e4c req-666877e9-cfdf-435c-95bc-9c5aa6558516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c97b65f6-e562-4206-ab12-768190a95c8e", "tag": "ef2fe3d1-ea07-489f-a271-7e4b5028cb3d"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:15.552050 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-23831dad-5c31-433c-8203-32e580128643 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:15.553199 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-23831dad-5c31-433c-8203-32e580128643 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:15.561860 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23831dad-5c31-433c-8203-32e580128643 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:15.562520 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23831dad-5c31-433c-8203-32e580128643 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:15.563111 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23831dad-5c31-433c-8203-32e580128643 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:15.563737 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-23831dad-5c31-433c-8203-32e580128643 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:15.569511 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-00372f47-a144-4977-9e3d-d80d46989e4c req-666877e9-cfdf-435c-95bc-9c5aa6558516 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:15.570315 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-00372f47-a144-4977-9e3d-d80d46989e4c req-666877e9-cfdf-435c-95bc-9c5aa6558516 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:15.592522 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-23831dad-5c31-433c-8203-32e580128643 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Going to try to terminate instance {{(pid=129370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:40:15.593987 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-00372f47-a144-4977-9e3d-d80d46989e4c req-666877e9-cfdf-435c-95bc-9c5aa6558516 service nova] Creating event network-changed:ef2fe3d1-ea07-489f-a271-7e4b5028cb3d for instance c97b65f6-e562-4206-ab12-768190a95c8e on hv-cinder-81268 Jun 30 18:40:15.604927 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-00372f47-a144-4977-9e3d-d80d46989e4c req-666877e9-cfdf-435c-95bc-9c5aa6558516 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066577 Jun 30 18:40:15.606436 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 353/728] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:15.711191 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-23831dad-5c31-433c-8203-32e580128643 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 204 len: 0 microversion: 2.1 time: 0.181443 Jun 30 18:40:15.713197 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 376/729] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:40:15 2022] DELETE /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:40:15.728967 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-1ff95256-c3ba-482a-ba4f-2fb9d167d986 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:15.730704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-1ff95256-c3ba-482a-ba4f-2fb9d167d986 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:15.743653 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1ff95256-c3ba-482a-ba4f-2fb9d167d986 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:15.745419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1ff95256-c3ba-482a-ba4f-2fb9d167d986 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:15.746475 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1ff95256-c3ba-482a-ba4f-2fb9d167d986 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:15.747021 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-1ff95256-c3ba-482a-ba4f-2fb9d167d986 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:15.910359 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-1ff95256-c3ba-482a-ba4f-2fb9d167d986 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:15.924804 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-1ff95256-c3ba-482a-ba4f-2fb9d167d986 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1576 microversion: 2.1 time: 0.204159 Jun 30 18:40:15.925839 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 354/730] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:15 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:16.949311 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-a5a21627-bb1a-4d6b-ba98-7100549dc3c8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:16.950510 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-a5a21627-bb1a-4d6b-ba98-7100549dc3c8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:16.966550 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a5a21627-bb1a-4d6b-ba98-7100549dc3c8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.979780 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a5a21627-bb1a-4d6b-ba98-7100549dc3c8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:16.981082 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a5a21627-bb1a-4d6b-ba98-7100549dc3c8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:16.981678 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-a5a21627-bb1a-4d6b-ba98-7100549dc3c8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:17.193342 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-a5a21627-bb1a-4d6b-ba98-7100549dc3c8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:17.210525 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-a5a21627-bb1a-4d6b-ba98-7100549dc3c8 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1576 microversion: 2.1 time: 0.266254 Jun 30 18:40:17.211567 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 377/731] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:16 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1576 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:18.185133 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-9741728b-3e3f-4abd-8844-3bd05a255b8e req-488a42fd-ed7c-4a7a-aebe-b4b2e14679d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c97b65f6-e562-4206-ab12-768190a95c8e", "name": "network-vif-deleted", "tag": "ef2fe3d1-ea07-489f-a271-7e4b5028cb3d"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:18.212732 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-9741728b-3e3f-4abd-8844-3bd05a255b8e req-488a42fd-ed7c-4a7a-aebe-b4b2e14679d8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:18.215624 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-9741728b-3e3f-4abd-8844-3bd05a255b8e req-488a42fd-ed7c-4a7a-aebe-b4b2e14679d8 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:18.233751 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-64ab9f1b-cc40-4b69-adc0-266ac1ae95dc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:18.234779 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-64ab9f1b-cc40-4b69-adc0-266ac1ae95dc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:18.238261 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-9741728b-3e3f-4abd-8844-3bd05a255b8e req-488a42fd-ed7c-4a7a-aebe-b4b2e14679d8 service nova] Creating event network-vif-deleted:ef2fe3d1-ea07-489f-a271-7e4b5028cb3d for instance c97b65f6-e562-4206-ab12-768190a95c8e on hv-cinder-81268 Jun 30 18:40:18.242545 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-64ab9f1b-cc40-4b69-adc0-266ac1ae95dc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:18.243105 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-64ab9f1b-cc40-4b69-adc0-266ac1ae95dc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:18.244684 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-64ab9f1b-cc40-4b69-adc0-266ac1ae95dc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:18.245110 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-9741728b-3e3f-4abd-8844-3bd05a255b8e req-488a42fd-ed7c-4a7a-aebe-b4b2e14679d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068583 Jun 30 18:40:18.245244 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-64ab9f1b-cc40-4b69-adc0-266ac1ae95dc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:18.251472 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 355/732] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:18.313651 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-64ab9f1b-cc40-4b69-adc0-266ac1ae95dc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:18.321789 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-64ab9f1b-cc40-4b69-adc0-266ac1ae95dc tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 200 len: 1225 microversion: 2.1 time: 0.092916 Jun 30 18:40:18.322475 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 378/733] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:18 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:19.340831 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:19.341532 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: c97b65f6-e562-4206-ab12-768190a95c8e] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:19.348440 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:19.348897 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:19.349690 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:19.350132 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:19.365508 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] HTTP exception thrown: Instance c97b65f6-e562-4206-ab12-768190a95c8e could not be found. Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Request method failure captured: Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e HTTP/1.1 Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABivewmOwbwMVVixGnzPy1ORZxF1E6fKLyeNMYeSRsvoo3D_2A9P95OH6JBdOlYPGdxp81kcUDnXCE6BeO05gQBZ6rDWD0EhgyTyS5BHuB6o43HvMjgdefd-KPHKJ1E_uCPNf9XMf5M4ogOL1euDkq1ajN-04Fud9g0tXWSxpNTnzL_v74 Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:40:19.367215 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}] Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 40078727842f491bb566e205065a65ad Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance c97b65f6-e562-4206-ab12-768190a95c8e could not be found. Jun 30 18:40:19.370070 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': 'c97b65f6-e562-4206-ab12-768190a95c8e'} Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c97b65f6-e562-4206-ab12-768190a95c8e could not be found. Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:40:19.371779 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c97b65f6-e562-4206-ab12-768190a95c8e could not be found. Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c97b65f6-e562-4206-ab12-768190a95c8e could not be found. Jun 30 18:40:19.375419 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:19.378051 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Returning 404 to user: Instance c97b65f6-e562-4206-ab12-768190a95c8e could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:40:19.378051 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-8ddbdc1f-7854-4117-a7ac-9e47f2c1a095 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e" status: 404 len: 111 microversion: 2.1 time: 0.032660 Jun 30 18:40:19.378051 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 356/734] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:19 2022] GET /compute/v2.1/servers/c97b65f6-e562-4206-ab12-768190a95c8e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:40:22.646917 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-86aae318-c882-4824-a438-04ee7b477f22 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:22.647733 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-86aae318-c882-4824-a438-04ee7b477f22 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:22.650407 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [req-bb9b50f3-3781-4c88-b184-47bfced11480 req-6ee136a7-503d-4c11-b7af-0a4c0f7f59a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ce02d9-81ad-4756-b262-ab001b8c39fe", "tag": "f9e024ca-30b9-4304-8bbd-160963181b23"}]} {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:22.655598 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-86aae318-c882-4824-a438-04ee7b477f22 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:22.656438 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-86aae318-c882-4824-a438-04ee7b477f22 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:22.657379 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-86aae318-c882-4824-a438-04ee7b477f22 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:22.658212 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-86aae318-c882-4824-a438-04ee7b477f22 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:22.668031 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-bb9b50f3-3781-4c88-b184-47bfced11480 req-6ee136a7-503d-4c11-b7af-0a4c0f7f59a4 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:22.669158 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [req-bb9b50f3-3781-4c88-b184-47bfced11480 req-6ee136a7-503d-4c11-b7af-0a4c0f7f59a4 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:22.693345 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.compute.server_external_events [req-bb9b50f3-3781-4c88-b184-47bfced11480 req-6ee136a7-503d-4c11-b7af-0a4c0f7f59a4 service nova] Creating event network-changed:f9e024ca-30b9-4304-8bbd-160963181b23 for instance 02ce02d9-81ad-4756-b262-ab001b8c39fe on hv-cinder-81268 Jun 30 18:40:22.693604 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-86aae318-c882-4824-a438-04ee7b477f22 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Going to try to terminate instance {{(pid=129370) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 18:40:22.702085 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [req-bb9b50f3-3781-4c88-b184-47bfced11480 req-6ee136a7-503d-4c11-b7af-0a4c0f7f59a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062596 Jun 30 18:40:22.703455 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 357/735] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:22.832273 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-86aae318-c882-4824-a438-04ee7b477f22 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "DELETE /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 204 len: 0 microversion: 2.1 time: 0.188890 Jun 30 18:40:22.834246 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 379/736] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:40:22 2022] DELETE /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 18:40:22.844915 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-3b4a2839-2cac-41bf-ad12-114f32fa42b9 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:22.845686 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-3b4a2839-2cac-41bf-ad12-114f32fa42b9 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:22.852711 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3b4a2839-2cac-41bf-ad12-114f32fa42b9 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:22.853148 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3b4a2839-2cac-41bf-ad12-114f32fa42b9 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:22.854140 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3b4a2839-2cac-41bf-ad12-114f32fa42b9 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:22.854604 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-3b4a2839-2cac-41bf-ad12-114f32fa42b9 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:23.061704 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-3b4a2839-2cac-41bf-ad12-114f32fa42b9 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:23.070074 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-3b4a2839-2cac-41bf-ad12-114f32fa42b9 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1577 microversion: 2.1 time: 0.230390 Jun 30 18:40:23.070712 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 358/737] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:22 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:24.089510 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-73a855b0-e611-40e1-aee6-4e9cd14a44ee tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:24.090276 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-73a855b0-e611-40e1-aee6-4e9cd14a44ee tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:24.097632 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-73a855b0-e611-40e1-aee6-4e9cd14a44ee tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:24.098088 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-73a855b0-e611-40e1-aee6-4e9cd14a44ee tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:24.098895 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-73a855b0-e611-40e1-aee6-4e9cd14a44ee tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:24.099335 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-73a855b0-e611-40e1-aee6-4e9cd14a44ee tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:24.290957 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.policy [None req-73a855b0-e611-40e1-aee6-4e9cd14a44ee tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129370) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:24.301006 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-73a855b0-e611-40e1-aee6-4e9cd14a44ee tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1577 microversion: 2.1 time: 0.215722 Jun 30 18:40:24.301663 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 380/738] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:24 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 18:40:25.322922 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-597f2027-241c-49a0-af26-b00046dcf919 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:25.323826 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-597f2027-241c-49a0-af26-b00046dcf919 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:25.335862 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-597f2027-241c-49a0-af26-b00046dcf919 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:25.336529 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-597f2027-241c-49a0-af26-b00046dcf919 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:25.337421 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-597f2027-241c-49a0-af26-b00046dcf919 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:25.338084 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-597f2027-241c-49a0-af26-b00046dcf919 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:25.434554 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.policy [None req-597f2027-241c-49a0-af26-b00046dcf919 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40078727842f491bb566e205065a65ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad915a3e597f4730a63420d59470f5b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129371) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 18:40:25.449875 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-597f2027-241c-49a0-af26-b00046dcf919 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 200 len: 1391 microversion: 2.1 time: 0.133889 Jun 30 18:40:25.450997 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 359/739] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:25 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 1391 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 18:40:25.462029 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [req-f613d050-7fa4-4842-b9cc-3716fecfc102 req-41300724-9c20-4020-a367-0ec46fc27975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ce02d9-81ad-4756-b262-ab001b8c39fe", "name": "network-vif-deleted", "tag": "f9e024ca-30b9-4304-8bbd-160963181b23"}]} {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 18:40:25.473417 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f613d050-7fa4-4842-b9cc-3716fecfc102 req-41300724-9c20-4020-a367-0ec46fc27975 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:25.474489 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [req-f613d050-7fa4-4842-b9cc-3716fecfc102 req-41300724-9c20-4020-a367-0ec46fc27975 service nova] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:25.493761 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.compute.server_external_events [req-f613d050-7fa4-4842-b9cc-3716fecfc102 req-41300724-9c20-4020-a367-0ec46fc27975 service nova] Creating event network-vif-deleted:f9e024ca-30b9-4304-8bbd-160963181b23 for instance 02ce02d9-81ad-4756-b262-ab001b8c39fe on hv-cinder-81268 Jun 30 18:40:25.503257 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [req-f613d050-7fa4-4842-b9cc-3716fecfc102 req-41300724-9c20-4020-a367-0ec46fc27975 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044836 Jun 30 18:40:25.504052 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 381/740] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Jun 30 18:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 18:40:26.469075 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:26.469717 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 02ce02d9-81ad-4756-b262-ab001b8c39fe] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:26.476814 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:26.477268 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:26.478062 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:26.478534 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:26.494975 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] HTTP exception thrown: Instance 02ce02d9-81ad-4756-b262-ab001b8c39fe could not be found. Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Request method failure captured: Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe HTTP/1.1 Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABivewmOwbwMVVixGnzPy1ORZxF1E6fKLyeNMYeSRsvoo3D_2A9P95OH6JBdOlYPGdxp81kcUDnXCE6BeO05gQBZ6rDWD0EhgyTyS5BHuB6o43HvMjgdefd-KPHKJ1E_uCPNf9XMf5M4ogOL1euDkq1ajN-04Fud9g0tXWSxpNTnzL_v74 Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:40:26.496671 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}] Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 40078727842f491bb566e205065a65ad Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 02ce02d9-81ad-4756-b262-ab001b8c39fe could not be found. Jun 30 18:40:26.503177 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '02ce02d9-81ad-4756-b262-ab001b8c39fe'} Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ce02d9-81ad-4756-b262-ab001b8c39fe could not be found. Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:40:26.504096 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ce02d9-81ad-4756-b262-ab001b8c39fe could not be found. Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ce02d9-81ad-4756-b262-ab001b8c39fe could not be found. Jun 30 18:40:26.506077 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:26.507405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Returning 404 to user: Instance 02ce02d9-81ad-4756-b262-ab001b8c39fe could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:40:26.507405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-b60a37da-efa1-477f-a597-3939207f0fb0 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe" status: 404 len: 111 microversion: 2.1 time: 0.033458 Jun 30 18:40:26.507405 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 360/741] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:26 2022] GET /compute/v2.1/servers/02ce02d9-81ad-4756-b262-ab001b8c39fe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:40:27.057653 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:27.058303 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.compute.api [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129370) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:27.065712 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:27.066161 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:27.067005 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:27.067452 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG oslo_concurrency.lockutils [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129370) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:27.084454 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.wsgi [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] HTTP exception thrown: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Request method failure captured: Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: request: DELETE /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f HTTP/1.1 Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept: application/json Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Accept-Encoding: identity Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Connection: close Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Length: 0 Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Content-Type: application/json Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Host: 10.222.0.16 Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Openstack-System-Scope: None Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: User-Agent: python-urllib3/1.26.9 Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Auth-Token: gAAAAABivewmOwbwMVVixGnzPy1ORZxF1E6fKLyeNMYeSRsvoo3D_2A9P95OH6JBdOlYPGdxp81kcUDnXCE6BeO05gQBZ6rDWD0EhgyTyS5BHuB6o43HvMjgdefd-KPHKJ1E_uCPNf9XMf5M4ogOL1euDkq1ajN-04Fud9g0tXWSxpNTnzL_v74 Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Id: None Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Domain-Name: None Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Identity-Status: Confirmed Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Is-Admin-Project: True Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Id: default Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Domain-Name: Default Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Project-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Role: reader,member Jun 30 18:40:27.086186 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Roles: reader,member Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}] Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Id: default Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Domain-Name: Default Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Id: 40078727842f491bb566e205065a65ad Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: X-User-Name: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: method: > Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: exception: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.088600 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: action_args: {'id': '24576f9c-71cf-4537-9f3b-6925dc85953f'} Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:40:27.090037 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.092971 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.095746 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Returning 404 to user: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. {{(pid=129370) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:40:27.095746 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-bb3d516c-f643-42b4-98b2-9f2b99ef7920 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 404 len: 111 microversion: 2.1 time: 0.034764 Jun 30 18:40:27.095746 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 382/742] 10.222.0.16 () {58 vars in 1238 bytes} [Thu Jun 30 18:40:27 2022] DELETE /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:40:27.100917 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '>' {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:27.101543 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.compute.api [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] [instance: 24576f9c-71cf-4537-9f3b-6925dc85953f] Fetching instance by UUID {{(pid=129371) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 18:40:27.109168 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:27.109738 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:27.110664 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 18:40:27.111153 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG oslo_concurrency.lockutils [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Lock "971563eb-4a0b-4a3d-98cf-496d4678315e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129371) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 18:40:27.127403 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.wsgi [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] HTTP exception thrown: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Request method failure captured: Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: request: GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f HTTP/1.1 Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept: application/json Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Accept-Encoding: identity Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Connection: close Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Length: 0 Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Content-Type: application/json Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Host: 10.222.0.16 Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Openstack-System-Scope: None Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: User-Agent: python-urllib3/1.26.9 Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Auth-Token: gAAAAABivewmOwbwMVVixGnzPy1ORZxF1E6fKLyeNMYeSRsvoo3D_2A9P95OH6JBdOlYPGdxp81kcUDnXCE6BeO05gQBZ6rDWD0EhgyTyS5BHuB6o43HvMjgdefd-KPHKJ1E_uCPNf9XMf5M4ogOL1euDkq1ajN-04Fud9g0tXWSxpNTnzL_v74 Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Id: None Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Domain-Name: None Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Identity-Status: Confirmed Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Is-Admin-Project: True Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Id: default Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Domain-Name: Default Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Project-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Role: reader,member Jun 30 18:40:27.128985 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Roles: reader,member Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ad915a3e597f4730a63420d59470f5b6"}]}] Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Id: ad915a3e597f4730a63420d59470f5b6 Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-Tenant-Name: tempest-TestVolumeBootPattern-1312555425 Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Id: default Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Domain-Name: Default Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Id: 40078727842f491bb566e205065a65ad Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: X-User-Name: tempest-TestVolumeBootPattern-1312555425-project Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: method: > Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: exception: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.131521 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: action_args: {'id': '24576f9c-71cf-4537-9f3b-6925dc85953f'} Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: {{(pid=129371) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 18:40:27.133161 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. Jun 30 18:40:27.136392 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: ERROR nova.api.openstack.wsgi Jun 30 18:40:27.138516 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: DEBUG nova.api.openstack.wsgi [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Returning 404 to user: Instance 24576f9c-71cf-4537-9f3b-6925dc85953f could not be found. {{(pid=129371) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 18:40:27.138516 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO nova.api.openstack.requestlog [None req-f8d53aa3-1a28-4455-8f3f-cebfeb9f4047 tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f" status: 404 len: 111 microversion: 2.1 time: 0.033876 Jun 30 18:40:27.138516 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: [pid: 129371|app: 0|req: 361/743] 10.222.0.16 () {58 vars in 1235 bytes} [Thu Jun 30 18:40:27 2022] GET /compute/v2.1/servers/24576f9c-71cf-4537-9f3b-6925dc85953f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 18:40:28.525460 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: DEBUG nova.api.openstack.wsgi [None req-ec53543f-b6be-4ed6-9dcf-76f59aae851e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] Calling method '.version_select at 0x7f8f3c1fec10>' {{(pid=129370) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 18:40:28.559946 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO nova.api.openstack.requestlog [None req-ec53543f-b6be-4ed6-9dcf-76f59aae851e tempest-TestVolumeBootPattern-1312555425 tempest-TestVolumeBootPattern-1312555425-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1800199925" status: 202 len: 0 microversion: 2.1 time: 0.041237 Jun 30 18:40:28.561330 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: [pid: 129370|app: 0|req: 383/744] 10.222.0.16 () {58 vars in 1262 bytes} [Thu Jun 30 18:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1800199925 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 18:41:17.105455 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:41:17.106122 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:41:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:41:26.332874 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:41:26.333560 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:41:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:42:59.251823 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:42:59.252801 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:43:02.615846 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:43:02.616542 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:43:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:43:18.482768 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:43:18.483408 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:43:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:44:37.114672 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:44:37.115112 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:44:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:44:46.341670 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:44:46.342246 dv-cinder-812685-15-iscsi devstack@n-api.service[129370]: Thu Jun 30 18:44:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 18:45:25.793135 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 18:45:25.793821 dv-cinder-812685-15-iscsi devstack@n-api.service[129371]: Thu Jun 30 18:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!